107 Commits

Author SHA1 Message Date
xm1k3
628b96f768
added force http2 option (#2919)
* added force http2 option

* implemented http2 with transport method

* fix and added forcehttp on clientpool

* updated readme with new flag

* option update

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-04 22:32:01 +05:30
Parth Malhotra
3014b40ac6
Fixes #2885 (#2886)
* docker go version update

* docker fix

* version update

* update chinese readme and typo fixes. (#2862)

* Fixes #2885

Fixes #2885

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Xc1Ym <xuedongyuming2233@gmail.com>
2022-11-23 18:21:22 +05:30
vrenzolaverace
2aaf2a2158
Use utils helpers libraries (#2809) (#2810)
* Use utils helpers libraries (#2809)

* Use utils helpers libraries (#2809)
2022-11-07 01:54:23 +05:30
mzack
2cf0005eaa updating syntax 2022-09-28 01:51:47 +02:00
Mzack9999
7ce03bcc5b
Optional use of local chrome for headless tests via tags (#2568) 2022-09-07 16:09:22 +05:30
Mzack9999
30054d1fb6
Adding advanced template filtering (#2374)
* Adding advanced template filtering

* fixing bug in slice

* refactoring tests

* adding test cases

* increasing error verbosity

* fixing quoted fields with spaces

* adding more test cases

* fixing merge error

* fixing lint errors

* switching to []string

* updating tag filter tests

* updating functional tests

* fixing functional test cases

* updating syntax
2022-08-25 16:52:08 +05:30
xixijun
2ae7e58c83
Fix socks5 proxy not working on tor proxy (#2455)
* fix: socks5 proxy not working on tor proxy

* fix: socks5 proxy not working on tor proxy

* minor refactoring

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-08-22 15:18:45 +05:30
forgedhallpass
d24736f655 fix typo in the headless setmethod function #2365 2022-07-29 14:38:07 +03:00
dependabot[bot]
85ca247d26
chore(deps): bump github.com/go-rod/rod from 0.107.3 to 0.108.1 in /v2 (#2272)
* chore(deps): bump github.com/go-rod/rod from 0.107.3 to 0.108.1 in /v2

Bumps [github.com/go-rod/rod](https://github.com/go-rod/rod) from 0.107.3 to 0.108.1.
- [Release notes](https://github.com/go-rod/rod/releases)
- [Commits](https://github.com/go-rod/rod/compare/v0.107.3...v0.108.1)

---
updated-dependencies:
- dependency-name: github.com/go-rod/rod
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* increasing page timeout

* further increasing timeout

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-07-14 03:14:13 +05:30
dependabot[bot]
1047047790
chore(deps): bump github.com/go-rod/rod from 0.106.8 to 0.107.1 in /v2 (#2114)
* chore(deps): bump github.com/go-rod/rod from 0.106.8 to 0.107.1 in /v2

Bumps [github.com/go-rod/rod](https://github.com/go-rod/rod) from 0.106.8 to 0.107.1.
- [Release notes](https://github.com/go-rod/rod/releases)
- [Commits](https://github.com/go-rod/rod/compare/v0.106.8...v0.107.1)

---
updated-dependencies:
- dependency-name: github.com/go-rod/rod
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* fixing function call

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-06-22 00:31:08 +05:30
Mzack9999
cc37382519
Adding Client TLS1.0 (#2091)
* Adding Client TLS1.0

* bumping fastdialer version
2022-06-04 17:45:16 +05:30
Mzack9999
4bcb94e4df
Increasing timeout and fixed error msg (#2092)
* Increasing timeout and fixed error msg

* increasing timeout
2022-06-02 00:00:18 +05:30
Mzack9999
39c7317ec3
Adding SNI override via request annotations (#1970)
* Adding SNI override via request annotations

* adding cli flag priority
2022-05-12 16:43:56 +05:30
Sami
6ca4374f91
sonar category: String literals should not be duplicated (#1944)
* sonar category: String literals should not be duplicated

* lint error fix

* better naming conventions for constants

* improved naming conventions and methods
2022-05-12 15:40:14 +05:30
Mzack9999
2f1330345f
Adding global SNI support for HTTP protocol via CLI (#1964)
* Adding global SNI support via CLI

* adding integration test

* adding cli option to docs

* reverting deleted test
2022-05-11 16:00:39 +05:30
mzack
d197b8df7b adding musl detection 2022-04-28 01:50:22 +02:00
mzack
3288c77692 fixing headless test cases 2022-03-22 13:47:13 +01:00
mzack
64bea4da8c Merge branch 'dev' into issue-1594-regexp 2022-03-02 17:28:04 +01:00
Sajad Parra
dc46bd263b add options to specify User-Agent in headless template 2022-02-24 12:31:08 +05:30
mzack
6746071979 Refactoring file templates to handle large files in chunks + removing deprecated io methods 2022-02-23 13:54:46 +01:00
mzack
54d8f9fdb5 Adding support for payloads in headless protocol 2022-02-04 11:43:42 +01:00
mzack
c701e2ad4a adding support for interactsh 2022-01-31 08:52:36 +01:00
mzack
2ba8e10050 Adding support for CLI/ENV vars to headless 2022-01-31 02:25:14 +01:00
mzack
695404477e Headless limited code refactor for better readability 2022-01-26 14:20:23 +01:00
Ice3man
6e71313d2b Misc changes to description 2022-01-17 15:35:27 +05:30
Mzack9999
0e8270c7b5
Replacing expression regex with lexical analyzer (#1440)
* Replacing regex with lexical analyzer taken from 610beb8534/v2/pkg/protocols/common/expressions/expressions.go (L66)
2022-01-09 17:22:04 +05:30
mzack
cf8bf50c9f fixing typo 2022-01-07 07:41:32 +01:00
mzack
1670bf874b fixing lint errors 2021-12-30 13:04:08 +01:00
mzack
7251a2ef60 implementing requested changes 2021-12-30 12:59:42 +01:00
mzack
0a6b84639b adding missing comments 2021-12-29 09:51:50 +01:00
mzack
5d699cdde0 Adding support for full navigation history to headless matchers 2021-12-29 09:48:46 +01:00
Sandeep Singh
df55f7a2eb
Disabling no-sandbox in headless engine (#1135)
* Disabling no-sandbox in headless engine

* limiting disabling sandbox to bare minimum

* adding warnings related to linux os and root user requirement

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2021-12-05 20:14:16 +05:30
Ice3man543
eb7c704d36 Merging from dev 2021-11-30 16:23:39 +05:30
forgedhallpass
5eca474c5e refactor(CR): better way of writing switch statement 2021-11-26 11:38:09 +02:00
forgedhallpass
7e22d70ded refactor/documentation: typos and grammatical errors 2021-11-25 18:54:16 +02:00
forgedhallpass
ec6889931d refactor: linter driven fixes
* x = x + ""  => x += ""
* pre-allocating slice with known size
* added t.Helper() methods in test helpers
* complex if-else conditions replaced by switches
* errors should be checked using error.Is() instead of ==
* function parameter should start with lower case letter
* removed unnecessary type definition
* variable/label naming convention: camelCase instead of snake_case
2021-11-25 17:57:22 +02:00
forgedhallpass
fdaa8e4539 refactor: removed redundant type conversion 2021-11-25 17:18:54 +02:00
forgedhallpass
47340f06b0 refactor: uniformly sorted imports 2021-11-25 17:09:20 +02:00
Ice3man543
caaa5c6594 Automatically generate docs for enum values 2021-11-25 19:34:01 +05:30
LuitelSamikshya
2856e7e247
Extractor + Headless Actions structures to enums (#1217)
* enum support for extractor
2021-11-19 01:41:10 +05:30
Mzack9999
ac75d9aa9b
Improving error handling in client certificate library (#1237) 2021-11-10 22:42:49 +05:30
LuitelSamikshya
0e46d3e041
feat: Checking socks5 proxy before launching a scan #1001 (#1225)
* Proxy validation and list input support

Co-authored-by: Sajad Parra <parrasajad@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2021-11-10 21:30:03 +05:30
kchason
c3503922c9 Merge remote-tracking branch 'origin/client-cert-auth' into client-cert-auth
# Conflicts:
#	v2/pkg/protocols/headless/engine/http_client.go
2021-10-27 12:15:12 -04:00
kchason
4a1440a17b Merge dev branch 2021-10-27 12:13:23 -04:00
kchason
a539184ffd Switch logic to a shared package 2021-10-27 12:11:42 -04:00
Ice3man
808ed4edd2
Merge branch 'dev' into client-cert-auth 2021-10-26 16:42:02 +05:30
Ice3man
e0afa2cee4
Merge pull request #1157 from projectdiscovery/issue-1095-realistic-http-client
Making headless httpclient more similar to real browsers
2021-10-26 16:39:21 +05:30
kchason
4b70560cc9 Merge branch 'master' into client-cert-auth 2021-10-21 13:59:39 -04:00
kchason
0a57a1aa4d Client certificate authentication for headless connections 2021-10-21 13:48:13 -04:00
mzack
e6728e8ff9 Making headless httpclient more similar to real browsers 2021-10-20 13:26:47 +02:00