Tarun Koyalwar
bdf77005d6
resolve merge conflicts
2023-06-27 20:21:14 +05:30
Mzack9999
c9d0942bc1
Extend headless contextargs ( #3850 )
...
* extend headless contextargs
* using darwin-latest
* grouping page options
* temp commenting code out
* fixing test
* adding more checks
* more checks
* fixing first navigation metadata
* adding integration test
* proto update
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-06-26 22:55:51 +05:30
Mzack9999
4d8c4b7024
Refactoring variables logic with map + get public ip ( #3853 )
...
* refactoring variables logic with map + get public ip
* moving to dsl package
* updating dep
* updating dsl with new ip endpoint
* deps bump
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-06-22 16:37:31 +05:30
Mzack9999
a7fb15d0bd
Adding support for code templates ( #2930 )
...
* Adding support for code templates
* adding support for python, powershell and echo (test)
* removing debug code
* introducing command + trivial trust store mechanism
* updating tests
* adding basic tests
* removing deprecated oracle
* mod tidy
* adding signature proto with debug prints
* removing debug code
* fixing test
* fixing param order
* improving test conditional build
* disable file+offlinehttp+code with cloud
* adding env vars
* removing debug code
* reorganizing test folders
* adding code template test prototype with dummy priv/pub keys
* bump go to 1.20
* fixing go version
* fixing lint errors
* adding fatal on pub-key test failure
* switching to ecdsa asn1
* removing unused signature
* fixing signature
* adding more tests
* extending core with engine args + powershell win test
* adding unsigned code test
* skip template signing in particular test case
* improving test coverage
* refactoring key names + adding already signed algo
* removing debug code
* fixing syntax
* fixing lint issues
* removing test template
* fixing dns tests path
* output fmt
* adding interact
* fixing lint issues
* adding -sign cli helper
* fixing nil pointer + parse inline keys
* making rsa default
* adding code prot. ref
* moving file to correct loc
* moving test
* Issue 3339 headless fuzz (#3790 )
* Basic headless fuzzing
* Remove debug statements
* Add integration tests
* Update template
* Fix recognize payload value in matcher
* Update tempalte
* use req.SetURL()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
* Auto Generate Syntax Docs + JSONSchema [Fri Jun 9 00:23:32 UTC 2023] 🤖
* Add headless header and status matchers (#3794 )
* add headless header and status matchers
* rename headers as header
* add integration test for header+status
* fix typo
* add retry to py-interactsh integration test
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Shubham Rasal <shubham@projectdiscovery.io>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: Dogan Can Bakir <65292895+dogancanbakir@users.noreply.github.com>
Co-authored-by: Tarun Koyalwar <45962551+tarunKoyalwar@users.noreply.github.com>
2023-06-09 20:54:24 +05:30
Tarun Koyalwar
e1d3f474a4
support for dynamic variables in template context (multi protocol execution) ( #3672 )
...
* multi proto request genesis
* adds template context dynamic vars
* feat: proto level resp variables
* remove proto prefix hacky logic
* implement template ctx args
* remove old var name logic
* improve AddTemplateVars func
* add multi proto comments+docs
* vardump with sorted keys
* fix race condition in ctx args
* default initialize ctx args
* use generic map
* index variables with multiple values
* fix nil cookies
* use synclock map
* fix build failure
* fix lint error
* resolve merge conflicts
* multi proto: add unit+ integration tests
* fix unit tests
* Issue 3339 headless fuzz (#3790 )
* Basic headless fuzzing
* Remove debug statements
* Add integration tests
* Update template
* Fix recognize payload value in matcher
* Update tempalte
* use req.SetURL()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
* Auto Generate Syntax Docs + JSONSchema [Fri Jun 9 00:23:32 UTC 2023] 🤖
* Add headless header and status matchers (#3794 )
* add headless header and status matchers
* rename headers as header
* add integration test for header+status
* fix typo
---------
Co-authored-by: Shubham Rasal <shubham@projectdiscovery.io>
Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: Dogan Can Bakir <65292895+dogancanbakir@users.noreply.github.com>
2023-06-09 19:52:56 +05:30
Shubham Rasal
a34b94e62f
Issue 3339 headless fuzz ( #3790 )
...
* Basic headless fuzzing
* Remove debug statements
* Add integration tests
* Update template
* Fix recognize payload value in matcher
* Update tempalte
* use req.SetURL()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-06-09 05:50:44 +05:30
Mzack9999
168d9e2c21
Extending multistep support ( #3546 )
...
* Extending multistep support
* duping buffer
* adding python pack/unpack
* fixing deps
* bump dsl version
* fixing go sum
* adding inline matchers/extractors
* pointing to latest dsl
* fixing looping
* refining inline matchers/extractors
* bumping dsl
* bump dsl
* show conn read errors
* removing redundant logic
superseded by js layer
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-06-01 06:19:19 +05:30
Keith Chason
4d6080f3bc
"Executer" to "Executor" ( #3760 )
...
* Fix spelling of "executer" to "executor"
* minor change: use defer file.Close()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-06-01 02:28:10 +05:30
Mzack9999
0d2d510689
Adding support for constants ( #3692 )
...
* adding support for constants
* fixing typo
* adding integration test
* fixing lint issues
* fixing template syntax
2023-05-25 22:02:35 +05:30
Mzack9999
dfd4d5b855
Adding interact keepalive to reduce server-side id pruning ( #3680 )
...
* adding interact keepalive + improving init logic
* dep update
* go version update
* readme update
* version bump
* fixing invalid format
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-05-21 01:56:13 +05:30
Shubham Rasal
2dd13b9afb
Allow additional properties for variables inside jsonschema ( #3669 )
...
* Allow additional properties in variables inside jsonschema
* Update variables jsonschema function
* Add tags for archive and mime-type
2023-05-15 19:15:11 +05:30
Tarun Koyalwar
c62dc01f9f
uncover logic refactor to v0.0.4 ( #3663 )
...
* uncover logic refactor to v0.0.4
* remove deprecated import: stringsutil
2023-05-09 03:57:56 +05:30
Shubham Rasal
449afc0c5c
Issue 3564 var override ( #3599 )
...
* Check if the variables are override by other means
- you can override the template variable value using command line flags
* Update lazy eval logic
- previously, we were checking any function/expression in variable
- now, update the logic, lazy eval only if variable contains any
protocol variable(global)
* add integration tests
* Add test to check the dsl function working in variable
* gather all generate variables logic in utils
* go mod update
* Refactor the generate variables function
* go mod update+ fix typo
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-05-02 23:49:56 +05:30
Tarun Koyalwar
7f5e4e2336
aws signer: fix missing x-content-sha256 header ( #3601 )
...
* fix missing x-content-sha256 header
* fix variable priority in self-contained templates
* remove debug statement
* adds generic raw request parser for self-contained req
* more integration tests
* bug fix: 10x faster race requests
* fix failing integration test
2023-05-01 12:15:35 +05:30
Mzack9999
ea5f8a0638
Additional nil check on interactsh client ( #3590 )
2023-04-25 23:49:23 +05:30
Mzack9999
978d0bcc23
Replacing goos with osutils ( #3571 )
...
* Replacing goos with osutils
* pleasing his majesty the linter
2023-04-19 23:00:15 +05:30
Tarun Koyalwar
bf08913cd0
update logic + config management refactor ( #3567 )
...
* adds template manager
* refactor: checkpoint
* centrailized config & template download logic
* refactor removed unused code
* use global template directory
* update related bug fixes
* bug fix create cfg dir if missing
* fix lint error
* bug fix skip writing template dir in callback
* misc update
* remove unused code
* use strings.equalfold for comparison
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-04-19 21:58:48 +05:30
Mzack9999
6f4b1ae48a
Replacing ccache with generic gcache ( #3523 )
...
* Replacing ccache with generic gcache
* fixing lint issues
* removing unecessary hashing + using errorutils
* making test more tolerant
* removing dead code + refactor
* removing redundant code
* removing race
* maint
* moving code
* adding more iterations
* note + typo
* temporary fixing stop-at-first-match with interact
* wrapping internal map with mux
* sort before running integration test
* fix deadlock in requestShouldStopAtFirstMatch
* add timeout to integration_test workflow
* attempting to remove outer lock
* adds interactsh protocol tests in integration_test
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-04-16 23:19:35 +05:30
Shubham Rasal
45cc676f96
Evaluate payload variables ( #3503 )
...
* Evaluate payload variables
* Add variables evaluation
* Extend variables test
- to check evaluation of global variables in variables
- to check evaluation of golbal variables in payload
* Add default and cli variables to websocket, whois and dns proto
- use url.Parse with urlutil.Parse
2023-04-12 01:50:58 +05:30
Tarun Koyalwar
f8c5a45966
add mkdir support in headless screenshot ( #3457 )
...
* add mkdir support in headless screenshot
* use filepath to join paths
* print info when screenshot is saved
* change version to v2.9.1-dev
* minor fixings on windows path
---------
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-03-24 00:44:32 +05:30
Mzack9999
4c0d988a67
reworking interact mutex mechanism
2023-03-17 14:41:16 +01:00
Tarun Koyalwar
c3771e874d
fix data race in internal resultevent ( #3432 )
2023-03-16 23:20:38 +05:30
Ramana Reddy
c9634fae72
Issue 3350 matcher condition or not work ( #3397 )
...
* fix or condition match even interactsh includes as matcher-part (#3350 )
* add integration test
* add new template to integration test
* matcher-condtion: test case for both conditions
* fix lint errors
* upgrade dependencies
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-15 20:45:44 +05:30
Austin Traver
0d90a555f6
adds -track-error option to add custom errors to max-host-error watchlist ( #3399 )
...
* Allow user to specify for "context deadline exceeded" errors to count toward the max host error count
* Convert flag to a string slice `--track-error`
* Minimize diff
* Add documentation for `-track-error`
* adds unit test & minor improvements
* update flag description
---------
Co-authored-by: Austin Traver <austin_traver@intuit.com>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-14 13:59:42 +05:30
xm1k3
32b79fdd36
used retryablehttp.DefaultClient().Do(req)
2023-03-02 09:35:53 +01:00
xm1k3
25098c8ea6
fix on ignore call
2023-03-02 09:01:24 +01:00
xm1k3
5959daa58f
removed nucleiVersion var as unused
2023-03-01 18:05:56 +01:00
xm1k3
ee6b1bef61
used retryablehttp for api requests
2023-03-01 16:50:21 +01:00
Mzack9999
d80cbef51d
Merge pull request #3333 from CodFrm/main
...
fix some json deserialization issues
2023-02-28 09:02:04 +01:00
王一之
27fefe59d3
fix json deserialization issues
2023-02-27 14:29:49 +08:00
Mzack9999
84abef3f70
Merge branch 'dev' into issue-2188-reporting-client
2023-02-24 15:58:43 +01:00
王一之
994988357a
adds missing json tags
2023-02-22 11:15:55 +08:00
Alexandre ZANNI
e3e60d0ba8
uncover: add criminalip support ( #3162 )
...
* update uncover engine options
* add criminalip support
* update criminalIP variable
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: shubhamrasal <shubhamdharmarasal@gmail.com>
2023-02-21 00:23:11 +05:30
Sandeep Singh
ba7fcd08ff
Merge branch 'dev' into issue-2188-reporting-client
2023-02-20 15:26:16 +05:30
王一之
85090b7531
fix some json deserialization issues
2023-02-17 14:21:25 +08:00
Mzack9999
d608ffaeb2
clear after stop ( #3312 )
...
* clear after stop
* fixing data races
* adding atomic cache
* fixing lint errors
* fixing imports
2023-02-13 16:46:41 +05:30
Ice3man
7e7bb1ed0a
AES CBC PKCS5Padding helper function update ( #3287 )
...
* Added DSL helper functions for CVE + misc
* Added aes_cbc with pkcspadding
* Misc
* Misc
* Misc
* Removed debug statement
* Misc
* Misc
* Fixed tests
2023-02-09 20:22:42 +05:30
Mzack9999
d57aec5ec7
converting reporting client to interface
2023-02-07 09:45:49 +01:00
Mzack9999
7556416e5b
adding interactsh support to sni ( #3276 )
2023-02-07 14:02:10 +05:30
Tarun Koyalwar
d18fa6f6b2
fix data race in race requests
2023-02-06 16:18:30 +05:30
Mzack9999
6c56a20544
Adding support for nmhe ( #3219 )
...
* adding support for nmhe
* updating docs
2023-01-22 15:08:50 +05:30
Mzack9999
e4402e7449
lowering hmap storage requirement via omitempty ( #3111 )
2023-01-12 20:01:45 +05:30
Tarun Koyalwar
e899afafdf
skip scanallip if input is ip ( #3186 )
...
* skip scanallips for ip input
* uncover,url parsing bug fix
* minor changes:best practices
2023-01-11 22:50:57 +05:30
Sandeep Singh
2d7948af55
Fixing host skipping error ( #3143 )
...
* removed error resulting into excessive error count
* banner update
2023-01-04 00:43:18 +05:30
Sandeep Singh
e66821b49f
Added more error + display skipped host on default run for more visibility. ( #3123 )
2023-01-02 19:00:10 +05:30
Sandeep Singh
212d0e5cfc
Adding more error to ignore with hosts ( #3121 )
2023-01-02 17:09:39 +05:30
xm1k3
34120fbecc
#3046 persistent failed item status and #2065 failed items reporting error once ( #3047 )
...
* added logs for debug
* fixes
* removed logs
* using cache item
* implemented multiple tests
* fixed some unit tests
* implemented test for skipping
* added multiple tests together
* added mark failed
* fix on tests
* better test implementation + concurrent
* fix: fixes on concurrent tests
* removed parallel and 1 unit test
DOCS: by default the command go test runs in parallel tests for different packages, and default is the number of CPUs available (see go help build)
* fixes on go routine
* increasing parallelism of once.Do
* bumping go to 1.19 for atomic types support
* removing redundant check + fixing test concurrency on create
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2023-01-02 13:52:06 +05:30
Mzack9999
34976029d3
removing most go routine leaks ( #3073 )
...
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-24 19:22:14 +05:30
Mzack9999
093d691c16
Issue 3033 deny list ( #3037 )
...
* fixing file deny list + refactoring
* err variable renaming
* removing redundant function
* removing unused code
* adding check on empty operator
* updating tests
2022-12-21 02:29:28 +05:30
Mzack9999
96c1dd3720
Adding custom ip to protocol generated variables ( #3011 )
...
* lint errors
* Extending context args support
* Ip => ip
2022-12-10 00:17:03 +05:30
