External/nuclei
1
0
Fork 0
mirror of https://github.com/projectdiscovery/nuclei.git synced 2025-12-24 07:25:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,920 Commits 49 Branches 135 Tags
Commit Graph

203 Commits

Author SHA1 Message Date
xm1k3
f26e01551e
resolve() helper function (#3321) 
* started the implementation of resolve helper function

* fixes go mod and sum

* fixes and use makeDslWithOptionalArgsFunction signature

* added tests

* added more dnsTypes based on dnsx docs

* used dns client pool

* dsl functions

* fixes on dnsclientpool, added init()

* go mod tidy

* go mod tidy

* dsl signature makeMultiSignatureDslFunction

* error on len

* managed mx

* fix on mx record

* dns types managed with FirstNonZero func

* error handling

* utils to stable version

* version bump

* fixing var name

---------

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2023-03-04 04:21:24 +05:30
Mzack9999
d80cbef51d
Merge pull request #3333 from CodFrm/main 
fix some json deserialization issues
 2023-02-28 09:02:04 +01:00
王一之
27fefe59d3 fix json deserialization issues 2023-02-27 14:29:49 +08:00
Mzack9999
62af038617
Add template sign/verify functionality (#3029) 
* add template sign/verify functionality

* fixing syntax
 2023-02-26 03:54:46 +05:30
Tarun Koyalwar
8cdc1338fc adds missing json tags and unit test 2023-02-22 02:24:45 +05:30
王一之
85090b7531 fix some json deserialization issues 2023-02-17 14:21:25 +08:00
xm1k3
cc2f796d2f
Helper function for IP Formats (#3286) 
* implemented ip_format helper function

* added tests on ip_format() helper

* fixes on logic

* fixes related to mapcidr docs

* better error value

* fixes + unit test to check index 11

* added call for integration tests

* fixes on dsl-functions number

---------

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2023-02-17 01:47:40 +05:30
Ice3man
7e7bb1ed0a
AES CBC PKCS5Padding helper function update (#3287) 
* Added DSL helper functions for CVE + misc

* Added aes_cbc with pkcspadding

* Misc

* Misc

* Misc

* Removed debug statement

* Misc

* Misc

* Fixed tests
 2023-02-09 20:22:42 +05:30
Mzack9999
1fbd2c069a
adding json schema for extractor (#3240) 
* adding json schema for extractor

* adding argument validation
 2023-02-07 14:01:34 +05:30
Dwi Siswanto
94ec553234
Add generate_jwt & json_{minify,prettify} helper functions (#3160) 
* feat(dsl): add generate_jwt helper func

* feat(dsl): add json_{minify,prettify} & quote_escape

* update(dsl): change type of data var to map[string]interface{}

* docs(dsl): list valid algos for generate_jwt

* test(dsl): add test case for json_{minify,prettify} & quote_escape

* update(dsl): refactor generate_jwt

* fix(lint): use time.Until instead of t.Sub(time.Now()) (gosimple)

* revert(dsl): remove quote_escape func

* ability to fuzz jwt noNe algorithm

* fix lint error

* jwt dsl minor improvement

Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
 2023-01-15 21:58:51 +05:30
Mzack9999
6cdff62381
removing unwanted print debug (#2995) 2022-12-28 21:19:06 +05:30
Mzack9999
093d691c16
Issue 3033 deny list (#3037) 
* fixing file deny list + refactoring

* err variable renaming

* removing redundant function

* removing unused code

* adding check on empty operator

* updating tests
 2022-12-21 02:29:28 +05:30
Sandeep Singh
6ae9eee8d3
README + misc updates (#2961) 
* readme update

* version + banner update

* misc option update

* go fmt'ed code

* misc update
 2022-12-04 20:51:33 +05:30
Mzack9999
d3a929d4c3 Making matcher name case insensitive 2022-11-25 17:22:50 +01:00
forgedhallpass
0295ca19bc
Add split DSL function (#2838) 
* Add support for showing overloaded DSL method signatures

* Add `split` DSL function #2837

* fixing lint warnings

* replacing faulty regex with strings methods

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
 2022-11-14 06:08:12 +05:30
vrenzolaverace
2aaf2a2158
Use utils helpers libraries (#2809) (#2810) 
* Use utils helpers libraries (#2809)

* Use utils helpers libraries (#2809)
 2022-11-07 01:54:23 +05:30
Ice3man
cd0517c887
Fixed invalid fields in request (#2788) 2022-11-01 16:10:41 +05:30
Ice3man
1fd83c03bc
Improved dsl test by removing coloring + fix datatime tests (#2654) 
* Improved dsl test by removing coloring + fix datatime tests

* Fixed tests for dsl coloring
 2022-10-06 03:18:05 +05:30
Mzack9999
18f14b631c
Adding same host redirect support (#2655) 
* simplifying test syntax

* adding same host redirect + refactoring redirect handling

* adding missing file

* adding support for template syntax

* adding integration test

* updating options

* fixing issue on same host redirect
 2022-09-29 04:11:28 +05:30
aprp
57b0d78dcf
add unit tests for extract.go (#2635) 2022-09-28 01:24:00 +05:30
Myung-jong Kim
9eea441b0e
Add sort(list), sort(string), uniq(list), uniq(string) helper functions (#2372) 
* Add feature in join() to sort a single string slice

Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>

* Add sort helper function and related tests

Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>

* Add uniq helper function and related tests

Signed-off-by: mjkim610 <mjkim610@gmail.com>

Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>
Signed-off-by: mjkim610 <mjkim610@gmail.com>
 2022-09-27 02:59:13 +05:30
Sami
f3eb0daa39
additional dsl functions (#2550) 
* additional dsl functions

* avoid conversion at each iteration
 2022-09-08 14:25:34 +05:30
forgedhallpass
fc0763641f
New dsl functions (#2545) 
* Update GO version to 1.18

* Removed redundant entry from the .gitignore file

* Added new DSL functions

to_unix_time(input string, optionalLayout string) int64
hex_to_dec(input string) float64
oct_to_dec(input string|number) float64
bin_to_dec(intput string|number) float64

* Notify if debug is enabled when a proxy cannot be validated

* Documentation: Go version requirement updated to 1.18

* test fix: Timezone agnostic date expectation in the assertion

* code review: extracted the default date-time layouts into a global variable
 2022-09-07 00:44:29 +05:30
James Turner
42a0732d68
Add sha512 support (#2517) 2022-08-31 12:36:02 +05:30
M. Ángel Jimeno
62a4e0aa52
Return wrapped errors for DSL compilation problems (#2492) 
This allows the DSL help information to be printed when in debug mode.

Fixes #2481
 2022-08-29 13:41:32 +05:30
51pwn
606c361b2a
Add substr and aes_cbc DSL functions (#2361) 
* 1、add DSL substr for #2304 By @hktalent
substr('xxtestxxx',2)。   testxxx
substr('xxtestxxx',2,-2)  testx
substr('xxtestxxx',2,6)   test

2、add DSL aes_cbc for #2243 By @hktalent
aes_cbc("key111key111key111key111", "dataxxxxxxdataxxxxxxdataxxxxxxdataxxxxxxdataxxxxxx")

3、fixed An error occurs when running nuclei with multiple instances #2301 By @hktalent

* refactoring helpers

* removing unwanted mutex

* commenting out test

* removing aes_cbc test due to random iv

Co-authored-by: 51pwn <51pwn@51pwn.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2022-08-25 15:50:08 +05:30
Ice3man
8f313629b8
Memory usage optimizations (#2350) 
* Replaced strings.Replaced with fasttemplate reducing allocations

Custom template parsing logic was replaced with fasttemplate package for reducing
allocations in the replacer.Replace hotpath leading to allocation reduction which
accounted for 30% of total nuclei allocations.

$ go test -bench=. -benchmem
goos: darwin
goarch: arm64
pkg: github.com/projectdiscovery/nuclei/v2/pkg/protocols/common/replacer
BenchmarkReplacer-8               837232              1422 ns/op            2112 B/op         31 allocs/op
BenchmarkReplacerNew-8           3672765               320.3 ns/op            48 B/op          4 allocs/op

* Fixed tests failing

* Use pre-compiled map of DSL expressions

* Reworked expression parsing logic to reduce memory allocations

$ go test -bench=. -benchmem
goos: darwin
goarch: arm64
pkg: github.com/projectdiscovery/nuclei/v2/pkg/protocols/common/expressions
BenchmarkEvaluate-8        31560             37769 ns/op           31731 B/op        265 allocs/op
BenchmarkEvaluateNew-8       109144              9621 ns/op            6253 B/op        116 allocs/op
 2022-08-23 13:16:41 +05:30
Dani Goland
8670c8b20d
Modified "xpath" extractor to support XML XPath in addition to HTML XPath (#2471) 
* Modified "xpath" extractor to support XML XPath in addition to HTML XPath

* Updated function docs
 2022-08-22 15:27:32 +05:30
Sajad
c4ba2b4edb
Additional helpers (#2359) 
* add starts_with, ends_with helper functions

* add test cases, update dsl signatures

* change split_starts_with to line_starts_with
 2022-08-06 23:16:03 +05:30
Mzack9999
3838d06aeb
Adding prototype for unexpected fields validation in matchers (#2171) 
* Adding unexpected fields validation

* using expected fields

* adding missing expected field

* using reflect
 2022-06-30 16:50:54 +05:30
Ice3man
7875b06fc8
Added exclude-matchers support for template & matchers (#2218) 
* Added exclude-matchers support for template & matchers

* Fixed panics due to typo

* Added support for only template ID + misc cleanup
 2022-06-24 23:09:27 +05:30
Ice3man
9073b753ca
Added aes_gcm implementation for DSL function (#2196) 
* Added aes_gcm implementation for DSL function

* Added integration test for dsl-functions.yaml
 2022-06-23 16:16:24 +05:30
Ice3man
50d21c0464
Fixed a issue with random invalid matches in DSL (#2195) 2022-06-21 21:58:43 +05:30
forgedhallpass
9fd9892f49 test: extra DSL function test cases 2022-06-08 20:58:46 +03:00
forgedhallpass
ef20e0711b refactor: replace date, time, time_format, time_to_string DSL functions to date_time 2022-06-08 20:33:55 +03:00
forgedhallpass
a10d58c6d2 refactor: rename concat_ws DSL function to join 2022-06-08 16:31:33 +03:00
forgedhallpass
145bdaabe5 refactor: extract duplicated hashing logic 2022-06-08 16:11:15 +03:00
forgedhallpass
6d8908c352 refactor: replace hmac_sha1 and hmac_sha256 DSL functions with hmac 2022-06-08 16:00:14 +03:00
James Turner
9d37bd6c0c Add two new DSL helper functions 
hmac_sha1 and concat_ws (with seperator) this are helpful in
signing API requests.
 2022-06-07 18:26:22 +03:00
forgedhallpass
f3514e9b92 Merge branch 'dev' into new_dsl_functions 2022-06-07 17:26:10 +03:00
Sajad
7170cc2828
dsl matcher separate ignorable(No parameter) errors from others (#2127) 2022-06-07 18:23:07 +05:30
Sajad
b79817e0a9
change dsl evaluate warning messages to error (#2096) 
* change dsl evaluate warning messages to error

* add template-id to dsl match error logs
 2022-06-03 13:41:36 +05:30
M4rtin Hsu
aebd32b198
Add decimal to hexadecimal helper function (#2076) 
* Add decimal to hexadecimal auxiliary functions

* Fixed unit test

* Modify the helper function name and check the unit test.

* dsl function update

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
 2022-06-03 02:17:35 +05:30
Sajad
9f600d2829
keep the original extactor var for multiple results while preparing data for matchers (#1948) 2022-05-31 02:46:51 +05:30
forgedhallpass
096f34e4e3 refactor: DSL date/time functions 2022-05-24 13:38:26 +03:00
forgedhallpass
346db4cf15 refactor: timetostring DSL to time_to_string 2022-05-24 13:11:55 +03:00
forgedhallpass
45c27bc5f0 test: DSL test fixes (hmac_sha256, time_format) 2022-05-24 13:11:03 +03:00
Rahmat
feae805834 Add hmac_sha256 dslExpression 2022-05-24 12:59:09 +03:00
Rahmat
f2ca75c536 Add time_format dslExpression 2022-05-24 12:47:56 +03:00
Mzack9999
72c5c399ec adding support for dsl extractors 2022-04-20 11:32:13 +02:00