Shubham Rasal
449afc0c5c
Issue 3564 var override ( #3599 )
...
* Check if the variables are override by other means
- you can override the template variable value using command line flags
* Update lazy eval logic
- previously, we were checking any function/expression in variable
- now, update the logic, lazy eval only if variable contains any
protocol variable(global)
* add integration tests
* Add test to check the dsl function working in variable
* gather all generate variables logic in utils
* go mod update
* Refactor the generate variables function
* go mod update+ fix typo
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-05-02 23:49:56 +05:30
Tarun Koyalwar
7f5e4e2336
aws signer: fix missing x-content-sha256 header ( #3601 )
...
* fix missing x-content-sha256 header
* fix variable priority in self-contained templates
* remove debug statement
* adds generic raw request parser for self-contained req
* more integration tests
* bug fix: 10x faster race requests
* fix failing integration test
2023-05-01 12:15:35 +05:30
Tarun Koyalwar
4e6ef4490e
duplicated params in self contained requests ( #3608 )
...
* fix duplicated params in self-contained+ export extracted values to file
* add integration tests + fix percentage overflow in pb
* fix integration test template id
* integration test: validate if file exists
2023-04-26 12:35:07 +05:30
Tarun Koyalwar
bf08913cd0
update logic + config management refactor ( #3567 )
...
* adds template manager
* refactor: checkpoint
* centrailized config & template download logic
* refactor removed unused code
* use global template directory
* update related bug fixes
* bug fix create cfg dir if missing
* fix lint error
* bug fix skip writing template dir in callback
* misc update
* remove unused code
* use strings.equalfold for comparison
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-04-19 21:58:48 +05:30
Shubham Rasal
d0f22f8b73
Issue 3488 http race ( #3533 )
...
* debug
* Add body after the request creation
* fix race_count template hangs
* remove printf
* update if condition
2023-04-19 01:57:53 +05:30
Mzack9999
6f4b1ae48a
Replacing ccache with generic gcache ( #3523 )
...
* Replacing ccache with generic gcache
* fixing lint issues
* removing unecessary hashing + using errorutils
* making test more tolerant
* removing dead code + refactor
* removing redundant code
* removing race
* maint
* moving code
* adding more iterations
* note + typo
* temporary fixing stop-at-first-match with interact
* wrapping internal map with mux
* sort before running integration test
* fix deadlock in requestShouldStopAtFirstMatch
* add timeout to integration_test workflow
* attempting to remove outer lock
* adds interactsh protocol tests in integration_test
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-04-16 23:19:35 +05:30
Ramana Reddy
6ffdfcf19c
fix rate-limit on query fuzzing ( #3458 ) ( #3532 )
2023-04-12 23:55:21 +05:30
Shubham Rasal
45cc676f96
Evaluate payload variables ( #3503 )
...
* Evaluate payload variables
* Add variables evaluation
* Extend variables test
- to check evaluation of global variables in variables
- to check evaluation of golbal variables in payload
* Add default and cli variables to websocket, whois and dns proto
- use url.Parse with urlutil.Parse
2023-04-12 01:50:58 +05:30
Mzack9999
4c0d988a67
reworking interact mutex mechanism
2023-03-17 14:41:16 +01:00
Tarun Koyalwar
c3771e874d
fix data race in internal resultevent ( #3432 )
2023-03-16 23:20:38 +05:30
Ramana Reddy
c9634fae72
Issue 3350 matcher condition or not work ( #3397 )
...
* fix or condition match even interactsh includes as matcher-part (#3350 )
* add integration test
* add new template to integration test
* matcher-condtion: test case for both conditions
* fix lint errors
* upgrade dependencies
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-15 20:45:44 +05:30
Shubham Rasal
572c8eb780
Issue 2987 fuzz options ( #3355 )
...
* Add override fuzzing type and mode flags
* Update english readme
* Fix failing tests
* Add the integration tests
- validate the command line overriding type and mode for fuzzing
2023-03-06 16:56:38 +05:30
Tarun Koyalwar
d9e953acfa
fix file input in custom vars for self contained http template ( #3385 )
...
* fix file input in variables(-V)
* fix lint error
* fix nuclei-ignore file failures
2023-03-04 04:57:27 +05:30
Mzack9999
d80cbef51d
Merge pull request #3333 from CodFrm/main
...
fix some json deserialization issues
2023-02-28 09:02:04 +01:00
王一之
27fefe59d3
fix json deserialization issues
2023-02-27 14:29:49 +08:00
Tarun Koyalwar
8cdc1338fc
adds missing json tags and unit test
2023-02-22 02:24:45 +05:30
Tarun Koyalwar
21b03a2e8a
bug fix in url path and adds integration tests ( #3331 )
...
* fix unsafe edgecases+ adds integration test
* bug fixes and more url testcases
* upgrade cfssl
* fix template id in integration test
2023-02-20 22:26:04 +05:30
王一之
85090b7531
fix some json deserialization issues
2023-02-17 14:21:25 +08:00
Mzack9999
d608ffaeb2
clear after stop ( #3312 )
...
* clear after stop
* fixing data races
* adding atomic cache
* fixing lint errors
* fixing imports
2023-02-13 16:46:41 +05:30
Tarun Koyalwar
e622b989fe
fix url re-encoding issues ( #3294 )
...
* fix double url encoding in urls
* remove extra slash
* url encode matchedURL
2023-02-10 18:28:28 +05:30
Mzack9999
7556416e5b
adding interactsh support to sni ( #3276 )
2023-02-07 14:02:10 +05:30
Tarun Koyalwar
32a6adb82e
fix data race in payload ( #3265 )
2023-02-05 00:00:01 +05:30
Tarun Koyalwar
628628893c
fix make http request inconsistencies ( #3243 )
...
* fix make http request inconsistencies
* remove parameters from http vars
* fix trailingslash unit test
* naming conventions: best practices
* fix publish docs action
* remove branch ref from push
2023-02-01 17:23:28 +05:30
Tarun Koyalwar
0b2a3e296a
fix url encoding issues and inconsistencies ( #3211 )
...
* fix url encoding issues
* complete requested changes and improvements
* fix missing issue-tracker-config.yaml
* fuzz: deepcopy and use urlutil.Params
2023-01-24 22:04:52 +05:30
Tarun Koyalwar
edcab07fec
fix aws signer missing template variables ( #3206 )
...
* aws sign: fix missing variables
* signer: add aws defaults
* aws signer default values
2023-01-24 20:50:20 +05:30
Tarun Koyalwar
6ebf5a789e
fix host spray race condition ( #3213 )
...
* core: bug fixes
* best practices: uniform comments
2023-01-20 23:49:04 +05:30
Tarun Koyalwar
f646e00c3d
fix unsafe raw request matchedUrl ( #3155 )
...
* fix unsafe raw request matchedurl
* quote metadata in CLI output
2023-01-05 21:02:36 +05:30
Tarun Koyalwar
4aa2002e72
urlencode key characters only ( #3150 )
...
* only encode key characters
* improve test cases
2023-01-05 16:41:59 +05:30
Tarun Koyalwar
e66ed30cec
fix missing trailing slash ( #3127 )
...
* raw: fix missing trailing slash
* adds rawpath integration test
* rename trailing slash test
2023-01-03 23:45:34 +05:30
Tarun Koyalwar
a5b39dcaa5
automerge url parameters from input and templates ( #3010 )
...
* fix automerge url parameters
* fix url encoding & refactor raw request
* handle trailing slash edgecases
* minor code refactoring
2022-12-13 12:09:31 +05:30
Mzack9999
96c1dd3720
Adding custom ip to protocol generated variables ( #3011 )
...
* lint errors
* Extending context args support
* Ip => ip
2022-12-10 00:17:03 +05:30
Ice3man
30f26a32ed
Do not consider fuzzing template during clustering
2022-12-05 23:07:38 +05:30
xm1k3
628b96f768
added force http2 option ( #2919 )
...
* added force http2 option
* implemented http2 with transport method
* fix and added forcehttp on clientpool
* updated readme with new flag
* option update
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-04 22:32:01 +05:30
Ice3man
514c6e2d1e
Added timestamp optional flag + user-agent to probing ( #2962 )
...
* Added timestamp optional flag + user-agent to probing
* fix typo
* misc update
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-04 22:16:55 +05:30
Tarun Koyalwar
3b31799847
Issue 2840 aws signature ( #2924 )
...
* docker go version update
* docker fix
* version update
* update chinese readme and typo fixes. (#2862 )
* fix aws request signer
* fix reader by upgrading retryablehttp-go
* go mod tidy
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Xc1Ym <xuedongyuming2233@gmail.com>
2022-12-03 07:10:57 +05:30
Ice3man
e7fb40a413
Added sandboxing for payload files and requests
2022-11-16 13:49:24 +05:30
Mzack9999
1fbbca66f9
Adding support to scan all v4/v6 IPs ( #2709 )
...
* Adding support to scan all v4/v6 IPs
* adding tests
* metainput prototype
* using new signature
* fixing nil pointer
* adding request context with metadata
* removing log instruction
* fixing merge conflicts
* adding clone helpers
* attempting to fix ipv6 square parenthesis wrap
* fixing dialed ip info
* fixing syntax
* fixing output ip selection
* adding integration tests
* disabling test due to gh ipv6 issue
* using ipv4 only due to GH limited networking
* extending metainput marshaling
* fixing hmap key
* adding test for httpx integration
* fixing lint error
* reworking marshaling/id-calculation
* adding ip version validation
* improving handling non url targets
* fixing condition check
2022-11-09 18:48:56 +05:30
vrenzolaverace
2aaf2a2158
Use utils helpers libraries ( #2809 ) ( #2810 )
...
* Use utils helpers libraries (#2809 )
* Use utils helpers libraries (#2809 )
2022-11-07 01:54:23 +05:30
Ice3man
b9472cf7e1
Added fuzzing support for query params + var dump feature ( #2679 )
...
* Added fuzzing support for query params + var dump feature
* Added query-fuzz integration test
* Fixed payloads + added keys-regex fuzz parameter
* Fixed interactsh not working + misc
* Fixed evaluation + added global variables/dsl support to payloads
* Misc fixes related to variables evaluations
* Added http variables support to fuzz
* misc
* Misc
* Added testing playground + misc renaming
* Added support for path and raw request to fuzzing
* Fixed fuzz integration test
* Fixed variable unresolved issue
* Add multiple parameter support with same name
* Added parameter value as 'value' dsl variable for parts
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-11-01 20:28:50 +05:30
Mzack9999
cc0c20053a
Improving unsafe uri path ( #2722 )
...
* Improving unsafe uri path
* fixing raw path output
2022-10-27 20:09:38 +02:00
Sajad
928f082109
set content_length as len(body) if response ContentLength is -1 ( #2407 )
...
* set content_length as len(body) if response ContentLength is -1
* move content-length calculation to utils
* adding basic tests
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-10-24 16:37:09 +02:00
Ice3man
d956f08cb9
Added attack-type option to override template attack-type ( #2724 )
...
* Added attack-type option to override template attack-type
* Added docs + integration tests
2022-10-19 03:51:45 +05:30
Mzack9999
9493dfdb20
Adding automatic request condition detection ( #2707 )
...
* Adding automatic request condition detection
* adding missing checks on part
* test update as per latest change
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-10-15 15:19:04 +05:30
mzack
70cecf83fb
Adding custom cancel function
2022-10-10 08:10:07 +02:00
Ice3man
9944f5e94e
Added response truncation support with flags ( #2688 )
...
* Added response truncation support with flags
* Fixed failing tests for no size
2022-10-07 20:10:00 +05:30
Mzack9999
781e4e6105
Shared Execution Context Prototype ( #2576 )
...
* renaming var
* Introducing shared execution context prototype
* fixing field name
* adding shared values propagation
* adding shared context lock
* add slice values normalization
* adding integration tests
* adding metadata support for dns
* adding multi-protocol context sharing test
* removing debug test files
* moving contextargs around
* adding comments
* refactoring code
- getter/setter for complex types
- using pointers to avoid heap allocations
2022-10-03 15:42:20 +05:30
Mzack9999
0b1ff2bfa4
Forcing conns to be gc-ed by default disabling keep-alive ( #2642 )
...
* Forcing conns to be gc-ed with keep-alive
* removing redundant code
keep-alive are disabled by default
* fixing merge conflict
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-09-30 04:25:56 +05:30
Mzack9999
18f14b631c
Adding same host redirect support ( #2655 )
...
* simplifying test syntax
* adding same host redirect + refactoring redirect handling
* adding missing file
* adding support for template syntax
* adding integration test
* updating options
* fixing issue on same host redirect
2022-09-29 04:11:28 +05:30
Mzack9999
99c14f4c9c
implementation of rate limiter with bucket refill and unrestricted token burst ( #2536 )
...
* implementation of rate limiter with interval burst
* fixing import path
* fixing syntax
* adding tests
* fixing lint errors
* adding support for context
* moving rate limiter earlier to avoid hitting timeout
2022-09-19 17:09:28 +05:30
Mzack9999
30054d1fb6
Adding advanced template filtering ( #2374 )
...
* Adding advanced template filtering
* fixing bug in slice
* refactoring tests
* adding test cases
* increasing error verbosity
* fixing quoted fields with spaces
* adding more test cases
* fixing merge error
* fixing lint errors
* switching to []string
* updating tag filter tests
* updating functional tests
* fixing functional test cases
* updating syntax
2022-08-25 16:52:08 +05:30
