389 Commits

Author SHA1 Message Date
LuitelSamikshya
cb0da81a14 ratelimit library 2022-10-12 22:04:37 -05:00
sandeep
c694fd82e5 readme update 2022-10-08 00:33:40 +05:30
Ice3man
6c93d99745 Fixed failing lint tests 2022-10-08 00:10:32 +05:30
Ice3man
9944f5e94e
Added response truncation support with flags (#2688)
* Added response truncation support with flags

* Fixed failing tests for no size
2022-10-07 20:10:00 +05:30
Mzack9999
781e4e6105
Shared Execution Context Prototype (#2576)
* renaming var

* Introducing shared execution context prototype

* fixing field name

* adding shared values propagation

* adding shared context lock

* add slice values normalization

* adding integration tests

* adding metadata support for dns

* adding multi-protocol context sharing test

* removing debug test files

* moving contextargs around

* adding comments

* refactoring code

- getter/setter for complex types
- using pointers to avoid heap allocations
2022-10-03 15:42:20 +05:30
Mzack9999
18f14b631c
Adding same host redirect support (#2655)
* simplifying test syntax

* adding same host redirect + refactoring redirect handling

* adding missing file

* adding support for template syntax

* adding integration test

* updating options

* fixing issue on same host redirect
2022-09-29 04:11:28 +05:30
Myung-jong Kim
9eea441b0e
Add sort(list), sort(string), uniq(list), uniq(string) helper functions (#2372)
* Add feature in join() to sort a single string slice

Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>

* Add sort helper function and related tests

Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>

* Add uniq helper function and related tests

Signed-off-by: mjkim610 <mjkim610@gmail.com>

Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>
Signed-off-by: mjkim610 <mjkim610@gmail.com>
2022-09-27 02:59:13 +05:30
Ice3man
fc27fc94a5
Added default config generation for reporting options (#2605) 2022-09-27 02:40:34 +05:30
Mzack9999
99c14f4c9c
implementation of rate limiter with bucket refill and unrestricted token burst (#2536)
* implementation of rate limiter with interval burst

* fixing import path

* fixing syntax

* adding tests

* fixing lint errors

* adding support for context

* moving rate limiter earlier to avoid hitting timeout
2022-09-19 17:09:28 +05:30
Ice3man
04b47b0309
Added custom json-unmarshaller + misc updates (#2556)
* Added custom json-unmarshaller + misc updates

* Added support for nuclei-cloud based scan execution

* Removed unnecessary files

* Misc

* Changes as per review comments

* misc option update

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-09-19 01:13:59 +05:30
Sami
f3eb0daa39
additional dsl functions (#2550)
* additional dsl functions

* avoid conversion at each iteration
2022-09-08 14:25:34 +05:30
James Turner
42a0732d68
Add sha512 support (#2517) 2022-08-31 12:36:02 +05:30
sullo
69709326d8
Add secunia to bad site list (#2516) 2022-08-30 12:29:30 +05:30
Ice3man
466176e9e8
Merge pull request #2500 from projectdiscovery/goflags-update
Updated goflags to latest + misc
2022-08-30 11:52:25 +05:30
mzack
e53614de0e correcting option type 2022-08-29 06:44:51 +02:00
Myung-jong Kim
01fbb3050d
Added option to list DSL function (#2497)
* Add lds flag

* misc flag update

* readme update

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-08-28 16:37:21 +05:30
Ice3man
043189472f Misc fixes to integration tests 2022-08-27 19:50:25 +05:30
Ice3man
8892250583 Updated goflags to latest + misc 2022-08-27 19:35:17 +05:30
sandeep
c34fd8b5c1 default timeout update 2022-08-27 13:46:23 +05:30
Sajad
011da1388d
add option to specify network interface (#2384)
* add option to specify network interface

* add source-ip flag

* fix typo

* fix err return

* readme update

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-08-25 17:42:35 +05:30
Mzack9999
30054d1fb6
Adding advanced template filtering (#2374)
* Adding advanced template filtering

* fixing bug in slice

* refactoring tests

* adding test cases

* increasing error verbosity

* fixing quoted fields with spaces

* adding more test cases

* fixing merge error

* fixing lint errors

* switching to []string

* updating tag filter tests

* updating functional tests

* fixing functional test cases

* updating syntax
2022-08-25 16:52:08 +05:30
Sami
0aac36a44b
added custom config flag (#2399)
* added custom config flag

* config.yaml file in custom  directory

* lint error fix

* few updates and error checks

* fix lint error

* copy config.yaml file if the dest folder does not exist

* lint error check

* added integration test

* improved test cases

* lint error fix
2022-08-25 16:10:07 +05:30
Ice3man
7b7936b7a5
Added show-actions flag to display headless actions (#2456)
* Added show-actions flag to display headless actions

* misc update

* readme update

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-08-25 10:43:32 +05:30
M. Ángel Jimeno
ecb3f21076
http: prevent HTTP 'connection' header from being added twice (#2480)
* http: prevent HTTP 'connection' header from being added twice

* misc fix

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-08-25 00:25:02 +05:30
Ice3man
e7cffad312
Fixed request annotation based timeout bugs + tests + misc (#2476) 2022-08-23 12:45:55 +05:30
Ice3man
275425589a
Added reference based tag addition to templates (#2464)
* Added reference based tag addition to templates

* reference mapping list update

* Misc changes as per review

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-08-22 18:11:08 +05:30
Ice3man
67d5769cd9
Added initial catalog interface implementation (#2318)
* Added initial catalog interface implementation

* Added OpenFile to Catalog + disk catalog implementation

* Fixed merge issues

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-08-10 11:05:58 -07:00
Ice3man
a190d8ff97
Added profile-mem flag for Memory profiling (#2292)
* Added profile flag for CPU and Memory profiling

* Updated DESIGN.md profiling instructions

* Misc

* Do only memory profiling

* Use gologger

* Misc
2022-08-09 11:19:23 -07:00
Sajad
c4ba2b4edb
Additional helpers (#2359)
* add starts_with, ends_with helper functions

* add test cases, update dsl signatures

* change split_starts_with to line_starts_with
2022-08-06 23:16:03 +05:30
Ice3man
a3eb5ebd4c
Added CISA KEV annotation support to cve-annotate (#2323)
* Added CISA KEV annotation support to cve-annotate

* Fixed lint errors
2022-07-21 21:30:15 +05:30
invist
db727db006
Optionally disable templates syntax strict check (#2266)
* nuclei::templates|define strict option (default)

* renaming flag and internal variable

* misc flag update

Co-authored-by: c-f <you@example.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-07-13 17:00:11 +05:30
Sami
6c2fdd3387
Issue 2227 ntv flag run new templates added in specific version (#2275)
* ntv flag to run templates added in specified version

* added missing arguments

* misc update

* added functional test and err check

* updated the min version

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-07-13 16:49:06 +05:30
Mzack9999
57b2ec7ade
Adding offline http tests (#2276) 2022-07-12 02:58:36 +05:30
Mzack9999
1c332bb85b
Improving RFC request/response passive parsing (#2192)
* Improving RFC request/response passive parsing

* adding test
2022-07-11 22:43:10 +05:30
sullo
fd9c865416
Add new sites to ban list (#2215)
* Add new sites to ban list
* ntelbras.com/
* andmp.com/
* blacklanternsecurity.com/
* pwnwiki.org/
* 0dayhack.net/
* correkt.horse/
* poc.wgpsec.org
* ctf\-writeup.revers3c.com/

* Update cve-annotate to use a contains instead of regex, as it's slightly faster

* Tighten up matchers a little

* small refactor

* Remove lead / from skip domains
Remove stray debug printf

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-07-08 20:28:22 +05:30
Mzack9999
476773ff8c
Replacing hasstdin with helper library (#2191)
* Replacing hasstdin with helper library

* adding timeout reader on stdin

* adding large input read timeout

* reducing stdin timeout + nostdin flag

* go mod update

* readme update

* go mod tidy

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-06-30 17:51:54 +05:30
Ice3man
ffe6ab04b3
Added include-templates force-loading for templates (#2232)
* Added include-templates force-loading for templates

* Fixed loader case with include-templates

* Added integration test for excluded-template in loader
2022-06-27 18:09:29 +05:30
Ice3man
7875b06fc8
Added exclude-matchers support for template & matchers (#2218)
* Added exclude-matchers support for template & matchers

* Fixed panics due to typo

* Added support for only template ID + misc cleanup
2022-06-24 23:09:27 +05:30
Ice3man
9073b753ca
Added aes_gcm implementation for DSL function (#2196)
* Added aes_gcm implementation for DSL function

* Added integration test for dsl-functions.yaml
2022-06-23 16:16:24 +05:30
Mzack9999
0b351e83f3
Add self diagnostic functionality (#2178)
* Adding Self-Diagnostic

* adding comment
2022-06-22 00:40:10 +05:30
mzack
c2f5b41ef3 Using library creategroup helper 2022-06-16 13:14:53 +02:00
sullo
a5fd6b79ab
Skip dead sites in reference annotation (#2156)
* Typo

* * Add list of dead reference sites
* Skip dead sites when annotating references

* Tighten up site regexes

* Lint cleanup

* One last url regex cleanup

* small code optimization

* using raw strings for regexes

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-06-14 11:04:00 +05:30
forgedhallpass
cadba90a5a test: extended the DSL helper integration test cases 2022-06-10 15:58:54 +03:00
forgedhallpass
179cf908a8 Revert "test: extended the DSL helper integration test cases"
This reverts commit ea0b6eae644f4965c34cd1436fc4e5ef6a597899.
2022-06-10 13:48:34 +03:00
forgedhallpass
ea0b6eae64 test: extended the DSL helper integration test cases 2022-06-10 13:33:16 +03:00
forgedhallpass
9fd9892f49 test: extra DSL function test cases 2022-06-08 20:58:46 +03:00
Ice3man
2b631e8e95
Add optional line number for file templates by default (#1966)
* Add optional line number for file templates by default

* updating docs

* misc flag update

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-06-02 17:06:50 +05:30
Ice3man
be5f1a7623
Added redirected matched URL + stop-at-first-match for redirect chains (#2050)
* Added redirected matched URL + stop-at-first-match for redirect chains

* Pleasing go-linter
2022-05-30 15:19:09 +05:30
Ice3man
34ed4e531a
Added hang monitor for goroutine dumping (#1949)
* Added hang monitor for goroutine dumping

* misc

* Made hang monitor optional with flag

* Added stack comparison for monitoring + misc

* Removed debug statements

* misc update

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-05-30 14:41:24 +05:30
Mzack9999
dd3b0a3cfc
Increasing buffer size on AND condition (#2030)
* Increasing buffer size on AND condition

* adding integration tests

* fixing tests data path
2022-05-30 13:45:28 +05:30