Tarun Koyalwar
bdf77005d6
resolve merge conflicts
2023-06-27 20:21:14 +05:30
Mzack9999
c9d0942bc1
Extend headless contextargs ( #3850 )
...
* extend headless contextargs
* using darwin-latest
* grouping page options
* temp commenting code out
* fixing test
* adding more checks
* more checks
* fixing first navigation metadata
* adding integration test
* proto update
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-06-26 22:55:51 +05:30
Mzack9999
fa199ed3b3
Improving clientpool with client certificates ( #3851 )
...
* Improving clientpool with client certificates
* adding test case
* Revert "Merge branch 'dev' into issue-3800-client-cert"
This reverts commit 7f057d742f4b9bda8e83b2052e29617b86b6776d, reversing
changes made to 7297cebcf8bb0f88961b644fc2ac7c040df8ffd9.
* Revert "Revert "Merge branch 'dev' into issue-3800-client-cert""
This reverts commit 2053a248a0cdc2002e0b4b4faa3472cf11c29760.
* go fmt
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-06-26 17:45:12 +05:30
Mzack9999
4d8c4b7024
Refactoring variables logic with map + get public ip ( #3853 )
...
* refactoring variables logic with map + get public ip
* moving to dsl package
* updating dep
* updating dsl with new ip endpoint
* deps bump
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-06-22 16:37:31 +05:30
Mzack9999
2a32ed9cba
Adding random tls impersonate ( #3844 )
...
* adding random tls impersonate
* dep update
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-06-21 17:17:18 +05:30
Sandeep Singh
0c8ec5e535
fix output path in unsafe mode ( #3831 )
...
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-06-20 01:25:22 +05:30
Ramana Reddy
cddae989f3
Add template option to disable merging target url path with raw request path ( #3799 )
...
* add template option to disable merging target url path with raw request path
* rename disable-merge-path -> disable-path-automerge
add integration test
2023-06-19 20:22:17 +05:30
Mzack9999
a4ef3ea3a9
fixing and condition
2023-06-13 17:24:23 +02:00
Mzack9999
a7fb15d0bd
Adding support for code templates ( #2930 )
...
* Adding support for code templates
* adding support for python, powershell and echo (test)
* removing debug code
* introducing command + trivial trust store mechanism
* updating tests
* adding basic tests
* removing deprecated oracle
* mod tidy
* adding signature proto with debug prints
* removing debug code
* fixing test
* fixing param order
* improving test conditional build
* disable file+offlinehttp+code with cloud
* adding env vars
* removing debug code
* reorganizing test folders
* adding code template test prototype with dummy priv/pub keys
* bump go to 1.20
* fixing go version
* fixing lint errors
* adding fatal on pub-key test failure
* switching to ecdsa asn1
* removing unused signature
* fixing signature
* adding more tests
* extending core with engine args + powershell win test
* adding unsigned code test
* skip template signing in particular test case
* improving test coverage
* refactoring key names + adding already signed algo
* removing debug code
* fixing syntax
* fixing lint issues
* removing test template
* fixing dns tests path
* output fmt
* adding interact
* fixing lint issues
* adding -sign cli helper
* fixing nil pointer + parse inline keys
* making rsa default
* adding code prot. ref
* moving file to correct loc
* moving test
* Issue 3339 headless fuzz (#3790 )
* Basic headless fuzzing
* Remove debug statements
* Add integration tests
* Update template
* Fix recognize payload value in matcher
* Update tempalte
* use req.SetURL()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
* Auto Generate Syntax Docs + JSONSchema [Fri Jun 9 00:23:32 UTC 2023] 🤖
* Add headless header and status matchers (#3794 )
* add headless header and status matchers
* rename headers as header
* add integration test for header+status
* fix typo
* add retry to py-interactsh integration test
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Shubham Rasal <shubham@projectdiscovery.io>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: Dogan Can Bakir <65292895+dogancanbakir@users.noreply.github.com>
Co-authored-by: Tarun Koyalwar <45962551+tarunKoyalwar@users.noreply.github.com>
2023-06-09 20:54:24 +05:30
Tarun Koyalwar
e1d3f474a4
support for dynamic variables in template context (multi protocol execution) ( #3672 )
...
* multi proto request genesis
* adds template context dynamic vars
* feat: proto level resp variables
* remove proto prefix hacky logic
* implement template ctx args
* remove old var name logic
* improve AddTemplateVars func
* add multi proto comments+docs
* vardump with sorted keys
* fix race condition in ctx args
* default initialize ctx args
* use generic map
* index variables with multiple values
* fix nil cookies
* use synclock map
* fix build failure
* fix lint error
* resolve merge conflicts
* multi proto: add unit+ integration tests
* fix unit tests
* Issue 3339 headless fuzz (#3790 )
* Basic headless fuzzing
* Remove debug statements
* Add integration tests
* Update template
* Fix recognize payload value in matcher
* Update tempalte
* use req.SetURL()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
* Auto Generate Syntax Docs + JSONSchema [Fri Jun 9 00:23:32 UTC 2023] 🤖
* Add headless header and status matchers (#3794 )
* add headless header and status matchers
* rename headers as header
* add integration test for header+status
* fix typo
---------
Co-authored-by: Shubham Rasal <shubham@projectdiscovery.io>
Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: Dogan Can Bakir <65292895+dogancanbakir@users.noreply.github.com>
2023-06-09 19:52:56 +05:30
Dogan Can Bakir
a4ca2021cd
Add headless header and status matchers ( #3794 )
...
* add headless header and status matchers
* rename headers as header
* add integration test for header+status
* fix typo
2023-06-09 15:03:03 +05:30
Shubham Rasal
a34b94e62f
Issue 3339 headless fuzz ( #3790 )
...
* Basic headless fuzzing
* Remove debug statements
* Add integration tests
* Update template
* Fix recognize payload value in matcher
* Update tempalte
* use req.SetURL()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-06-09 05:50:44 +05:30
Mzack9999
168d9e2c21
Extending multistep support ( #3546 )
...
* Extending multistep support
* duping buffer
* adding python pack/unpack
* fixing deps
* bump dsl version
* fixing go sum
* adding inline matchers/extractors
* pointing to latest dsl
* fixing looping
* refining inline matchers/extractors
* bumping dsl
* bump dsl
* show conn read errors
* removing redundant logic
superseded by js layer
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-06-01 06:19:19 +05:30
Keith Chason
4d6080f3bc
"Executer" to "Executor" ( #3760 )
...
* Fix spelling of "executer" to "executor"
* minor change: use defer file.Close()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-06-01 02:28:10 +05:30
Mzack9999
0d2d510689
Adding support for constants ( #3692 )
...
* adding support for constants
* fixing typo
* adding integration test
* fixing lint issues
* fixing template syntax
2023-05-25 22:02:35 +05:30
Mzack9999
dfd4d5b855
Adding interact keepalive to reduce server-side id pruning ( #3680 )
...
* adding interact keepalive + improving init logic
* dep update
* go version update
* readme update
* version bump
* fixing invalid format
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-05-21 01:56:13 +05:30
Shubham Rasal
2dd13b9afb
Allow additional properties for variables inside jsonschema ( #3669 )
...
* Allow additional properties in variables inside jsonschema
* Update variables jsonschema function
* Add tags for archive and mime-type
2023-05-15 19:15:11 +05:30
Shubham Rasal
06ab56abea
fix memory leak in dns templates ( #3676 )
...
* fix memory leak
* update test to cover the string slice case
2023-05-12 17:29:37 +05:30
Shubham Rasal
9c2fa8f9c4
Add payload in dns protocol ( #3632 )
...
* add execute function in dns
* Add payload in dns protocol
* Add integration test to cover dns payload
- also check command line overriding a payload variable
* Update matchedAt and remove trailing dot
* Consider payload data for request count
- Update verbose output to print question
- Update dns requests Requests function to consider payload data
* update gitignore
* bump nuclei version to v2.9.4-dev
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-05-11 03:26:29 +05:30
Tarun Koyalwar
c62dc01f9f
uncover logic refactor to v0.0.4 ( #3663 )
...
* uncover logic refactor to v0.0.4
* remove deprecated import: stringsutil
2023-05-09 03:57:56 +05:30
sandeep
82f7a0e939
added any dns query
2023-05-03 21:50:06 +05:30
Tarun Koyalwar
9b3a55d6c0
fix panic while parsing tlsx response ( #3641 )
2023-05-03 20:47:08 +05:30
lu4nx
027880af34
update rod to v0.112.9 #3552 ( #3637 )
...
* update rod to v0.112.9
* removed unused reflection
---------
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-05-03 14:40:58 +05:30
Shubham Rasal
449afc0c5c
Issue 3564 var override ( #3599 )
...
* Check if the variables are override by other means
- you can override the template variable value using command line flags
* Update lazy eval logic
- previously, we were checking any function/expression in variable
- now, update the logic, lazy eval only if variable contains any
protocol variable(global)
* add integration tests
* Add test to check the dsl function working in variable
* gather all generate variables logic in utils
* go mod update
* Refactor the generate variables function
* go mod update+ fix typo
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-05-02 23:49:56 +05:30
Shubham Rasal
f640187709
Expose DNS fields for matchers and extractors ( #3613 )
...
* Extend dns extractor to dns answer records
* add test template
* Ignore error for dns variables are not found
* Add all the records of answer section
* Fixed the wrong typecasting
2023-05-02 17:13:11 +05:30
Suraj Kamath
537814bae8
Fix check for OS made in MustDisableSandbox() ( #3631 )
...
Signed-off-by: iamargus95 <kamathsuraj95@gmail.com>
2023-05-02 15:04:24 +05:30
Tarun Koyalwar
7f5e4e2336
aws signer: fix missing x-content-sha256 header ( #3601 )
...
* fix missing x-content-sha256 header
* fix variable priority in self-contained templates
* remove debug statement
* adds generic raw request parser for self-contained req
* more integration tests
* bug fix: 10x faster race requests
* fix failing integration test
2023-05-01 12:15:35 +05:30
Tarun Koyalwar
4e6ef4490e
duplicated params in self contained requests ( #3608 )
...
* fix duplicated params in self-contained+ export extracted values to file
* add integration tests + fix percentage overflow in pb
* fix integration test template id
* integration test: validate if file exists
2023-04-26 12:35:07 +05:30
Mzack9999
ea5f8a0638
Additional nil check on interactsh client ( #3590 )
2023-04-25 23:49:23 +05:30
Mzack9999
64adad131f
Removing redundant code with utils
2023-04-23 21:37:25 +02:00
Mzack9999
978d0bcc23
Replacing goos with osutils ( #3571 )
...
* Replacing goos with osutils
* pleasing his majesty the linter
2023-04-19 23:00:15 +05:30
Tarun Koyalwar
bf08913cd0
update logic + config management refactor ( #3567 )
...
* adds template manager
* refactor: checkpoint
* centrailized config & template download logic
* refactor removed unused code
* use global template directory
* update related bug fixes
* bug fix create cfg dir if missing
* fix lint error
* bug fix skip writing template dir in callback
* misc update
* remove unused code
* use strings.equalfold for comparison
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-04-19 21:58:48 +05:30
Shubham Rasal
d0f22f8b73
Issue 3488 http race ( #3533 )
...
* debug
* Add body after the request creation
* fix race_count template hangs
* remove printf
* update if condition
2023-04-19 01:57:53 +05:30
Mzack9999
6f4b1ae48a
Replacing ccache with generic gcache ( #3523 )
...
* Replacing ccache with generic gcache
* fixing lint issues
* removing unecessary hashing + using errorutils
* making test more tolerant
* removing dead code + refactor
* removing redundant code
* removing race
* maint
* moving code
* adding more iterations
* note + typo
* temporary fixing stop-at-first-match with interact
* wrapping internal map with mux
* sort before running integration test
* fix deadlock in requestShouldStopAtFirstMatch
* add timeout to integration_test workflow
* attempting to remove outer lock
* adds interactsh protocol tests in integration_test
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-04-16 23:19:35 +05:30
Ramana Reddy
6ffdfcf19c
fix rate-limit on query fuzzing ( #3458 ) ( #3532 )
2023-04-12 23:55:21 +05:30
Shubham Rasal
45cc676f96
Evaluate payload variables ( #3503 )
...
* Evaluate payload variables
* Add variables evaluation
* Extend variables test
- to check evaluation of global variables in variables
- to check evaluation of golbal variables in payload
* Add default and cli variables to websocket, whois and dns proto
- use url.Parse with urlutil.Parse
2023-04-12 01:50:58 +05:30
mlec
ed31fc4449
fix(links): Replace Master to Main in links 🩹 ( #3485 )
...
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-03-31 16:27:15 +05:30
Keith Chason
5b97536c0e
Correct typo "Ciper" to "Cipher" ( #3468 )
2023-03-27 18:48:27 +05:30
Tarun Koyalwar
f8c5a45966
add mkdir support in headless screenshot ( #3457 )
...
* add mkdir support in headless screenshot
* use filepath to join paths
* print info when screenshot is saved
* change version to v2.9.1-dev
* minor fixings on windows path
---------
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-03-24 00:44:32 +05:30
Mzack9999
4c0d988a67
reworking interact mutex mechanism
2023-03-17 14:41:16 +01:00
Tarun Koyalwar
c3771e874d
fix data race in internal resultevent ( #3432 )
2023-03-16 23:20:38 +05:30
Ramana Reddy
c9634fae72
Issue 3350 matcher condition or not work ( #3397 )
...
* fix or condition match even interactsh includes as matcher-part (#3350 )
* add integration test
* add new template to integration test
* matcher-condtion: test case for both conditions
* fix lint errors
* upgrade dependencies
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-15 20:45:44 +05:30
Austin Traver
0d90a555f6
adds -track-error option to add custom errors to max-host-error watchlist ( #3399 )
...
* Allow user to specify for "context deadline exceeded" errors to count toward the max host error count
* Convert flag to a string slice `--track-error`
* Minimize diff
* Add documentation for `-track-error`
* adds unit test & minor improvements
* update flag description
---------
Co-authored-by: Austin Traver <austin_traver@intuit.com>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-14 13:59:42 +05:30
Shubham Rasal
572c8eb780
Issue 2987 fuzz options ( #3355 )
...
* Add override fuzzing type and mode flags
* Update english readme
* Fix failing tests
* Add the integration tests
- validate the command line overriding type and mode for fuzzing
2023-03-06 16:56:38 +05:30
Mzack9999
d7ac306bdf
Adding one-time method override ( #3373 )
2023-03-04 12:27:26 +05:30
Tarun Koyalwar
d9e953acfa
fix file input in custom vars for self contained http template ( #3385 )
...
* fix file input in variables(-V)
* fix lint error
* fix nuclei-ignore file failures
2023-03-04 04:57:27 +05:30
Tarun Koyalwar
3e53087617
fix missing port in matched ssl templates ( #3380 )
...
* add openssl support + fix missing port
* fix failing tests
* go mod update
* workflow update
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-03-04 04:47:41 +05:30
xm1k3
32b79fdd36
used retryablehttp.DefaultClient().Do(req)
2023-03-02 09:35:53 +01:00
xm1k3
25098c8ea6
fix on ignore call
2023-03-02 09:01:24 +01:00
xm1k3
5959daa58f
removed nucleiVersion var as unused
2023-03-01 18:05:56 +01:00
