Tarun Koyalwar
f7fe99f806
add flow support in template (i.e javascript scripting) ( #4015 )
...
* add flow logic
* progress
* working POC
* fix string slice normalization issue in variables
* update
* fix nil panic
* remove poll()
* load file with sandbox and more
* fix failing integration tests
* JS: log: print in vardump format
* fix missing id in protocols
* fix proto prefix in template context
* flow: add unit tests
* conditional flow support using flow
* fix proto callbacks + more unit tests
* adds integration test
* conditional flow: check if req has any matchers
* fix lint error
* deprecate iterate-all+ missing multi-proto implementation
* fix ip input in raw request
* JS: feat dedupe object+ more builtin funcs
* feat: hide protocol result using hide
* feat: async execution
* complete async execution support
* fix condition-flow without any matchers
* refactor: template executer package (tmplexec)
* flow executor working
* fix data race in templateCtx
* templateCtx redesign
* fix failing unit test
* add multiprotocol support to deprecated syntax
* fix race condition in utils & tlsx
* add documentation in flow package
* remove regions.txt file
* fix minor issue with self contained templates
* fix typos of copilot
* dep + misc update
* fix reqID: use req.Type instead of template.Type
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-08-31 18:03:01 +05:30
Tarun Koyalwar
8125b6805c
resolve merge conflicts with dev
2023-08-04 20:21:22 +05:30
sandeep
bd9e75d9bd
version update
2023-08-02 17:58:58 +05:30
Josh Soref
4c1c5301b9
Spelling ( #4008 )
...
* spelling: addresses
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: asynchronous
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: basic
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: brute force
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: constant
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: disables
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: engine
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: every time
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: execution
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: false positives
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: from
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: further
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: github
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: gitlab
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: highlight
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: hygiene
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: ignore
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: input
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: item
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: itself
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: latestxxx
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: navigation
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: negative
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: nonexistent
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: occurred
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: override
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: overrides
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: payload
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: performed
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: respective
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: retrieve
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: scanlist
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: separated
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: separator
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: severity
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: source
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: strategy
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: string
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: templates
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: terminal
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: timeout
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: trailing slash
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: trailing
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
* spelling: websocket
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
---------
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2023-08-02 00:03:43 +05:30
sandeep
3894d466ad
version update
2023-07-28 21:43:09 +05:30
lu4nx
9adce978b4
Support wildcard matching for the -template-id parameter ( #3967 )
...
* Support wildcard matching for the `-template-id' parameter
* Remove _ identifier
* Fix: If tagFilter.allowedIds is empty, included should be true.
2023-07-28 21:01:28 +05:30
sandeep
0828339de6
version update
2023-07-18 03:24:39 +05:30
Keith Chason
08e1ab9ddd
Disable Template Locations ( #3705 ) ( #3926 )
...
* Download override option definition
* Update the variable names for consistency
* Add checks for custom template disable flags
* Environment variable controlled template downloads
* Switch env naming per feedback from @ehsandeep
* minor changes
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-07-18 00:53:10 +05:30
Sandeep Singh
9a44deb9e1
added epss-percentile field under classification ( #3911 )
...
* added epss-percentile field under classification
* lint fix
2023-07-09 01:19:56 +05:30
sandeep
daecd169c5
version update
2023-07-03 18:24:01 +05:30
Tarun Koyalwar
bdf77005d6
resolve merge conflicts
2023-06-27 20:21:14 +05:30
sandeep
bf7684205e
version update
2023-06-27 00:52:04 +05:30
Mzack9999
fa199ed3b3
Improving clientpool with client certificates ( #3851 )
...
* Improving clientpool with client certificates
* adding test case
* Revert "Merge branch 'dev' into issue-3800-client-cert"
This reverts commit 7f057d742f4b9bda8e83b2052e29617b86b6776d, reversing
changes made to 7297cebcf8bb0f88961b644fc2ac7c040df8ffd9.
* Revert "Revert "Merge branch 'dev' into issue-3800-client-cert""
This reverts commit 2053a248a0cdc2002e0b4b4faa3472cf11c29760.
* go fmt
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-06-26 17:45:12 +05:30
Mzack9999
a7fb15d0bd
Adding support for code templates ( #2930 )
...
* Adding support for code templates
* adding support for python, powershell and echo (test)
* removing debug code
* introducing command + trivial trust store mechanism
* updating tests
* adding basic tests
* removing deprecated oracle
* mod tidy
* adding signature proto with debug prints
* removing debug code
* fixing test
* fixing param order
* improving test conditional build
* disable file+offlinehttp+code with cloud
* adding env vars
* removing debug code
* reorganizing test folders
* adding code template test prototype with dummy priv/pub keys
* bump go to 1.20
* fixing go version
* fixing lint errors
* adding fatal on pub-key test failure
* switching to ecdsa asn1
* removing unused signature
* fixing signature
* adding more tests
* extending core with engine args + powershell win test
* adding unsigned code test
* skip template signing in particular test case
* improving test coverage
* refactoring key names + adding already signed algo
* removing debug code
* fixing syntax
* fixing lint issues
* removing test template
* fixing dns tests path
* output fmt
* adding interact
* fixing lint issues
* adding -sign cli helper
* fixing nil pointer + parse inline keys
* making rsa default
* adding code prot. ref
* moving file to correct loc
* moving test
* Issue 3339 headless fuzz (#3790 )
* Basic headless fuzzing
* Remove debug statements
* Add integration tests
* Update template
* Fix recognize payload value in matcher
* Update tempalte
* use req.SetURL()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
* Auto Generate Syntax Docs + JSONSchema [Fri Jun 9 00:23:32 UTC 2023] 🤖
* Add headless header and status matchers (#3794 )
* add headless header and status matchers
* rename headers as header
* add integration test for header+status
* fix typo
* add retry to py-interactsh integration test
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Shubham Rasal <shubham@projectdiscovery.io>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: Dogan Can Bakir <65292895+dogancanbakir@users.noreply.github.com>
Co-authored-by: Tarun Koyalwar <45962551+tarunKoyalwar@users.noreply.github.com>
2023-06-09 20:54:24 +05:30
三米前有蕉皮
b4e4715d36
deprecatedProtocolNameTemplates concurrent map writes ( #3785 )
...
* deprecatedProtocolNameTemplates
* use syncLock
* fix lint error
* change version in deprecated warning msg
* comment asnmap expand unit test
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
Co-authored-by: Tarun Koyalwar <45962551+tarunKoyalwar@users.noreply.github.com>
2023-06-08 23:58:40 +05:30
sandeep
82d974ae85
version update
2023-06-01 17:39:28 +05:30
Keith Chason
4d6080f3bc
"Executer" to "Executor" ( #3760 )
...
* Fix spelling of "executer" to "executor"
* minor change: use defer file.Close()
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-06-01 02:28:10 +05:30
sandeep
8731282282
Merge remote-tracking branch 'origin' into dev
2023-05-28 17:12:23 +05:30
sandeep
74ab1428be
Merge branch 'dev'
2023-05-28 16:58:08 +05:30
sandeep
44f8f6bb67
version update
2023-05-28 16:20:04 +05:30
Mzack9999
52973843c1
removing .yml from remote loading ( #3745 )
2023-05-27 01:40:18 +05:30
sandeep
20bc5fc607
version update
2023-05-21 02:21:07 +05:30
Keith Chason
42a59189f3
Fix mis-spellings and other comment cleanup ( #3704 )
2023-05-19 21:06:39 +05:30
sandeep
06f242e5fc
version update
2023-05-12 05:18:32 +05:30
Tarun Koyalwar
4a6a0185f5
Feat template update improvements ( #3675 )
...
* path modification of official templates
* fix deprecated paths counter
* add reset flag to nuclei
* bug fix: deprecated path counter
* ignore meta files
* purge empty dirs
* fix lint error
2023-05-12 05:17:19 +05:30
sandeep
ced8d96df2
dev version update
2023-05-09 15:13:40 +05:30
sandeep
79a1c99da7
version update
2023-05-04 01:47:41 +05:30
Tarun Koyalwar
37aaa5ebaa
add support for resolving old template paths ( #3635 )
...
* add support for resolving old template paths
* skip resolving if new path is specified
* add debug statement
* show error if fallback failed
* remove debug statement
* remove fallback errors
* print warning for deprecated paths
* add warnings for deprecated paths/protocol names
* misc update
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-05-04 01:43:41 +05:30
Dogan Can Bakir
4e0ccb38be
Check severity att while validating ( #3540 )
...
* Make severity attribute required
* Update test err msg
* minor
* Do not strict check serverity
* Fix failing test
* Don't print warning in workflow loader
- workflow loader that contains tags load all the template and parse it
- i.e it iw printing warning recursively, ignore as the templates
already getting valiated
* Fix error typo
* Resolve comments
- split the function into two diff
---------
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: shubhamrasal <shubhamdharmarasal@gmail.com>
2023-04-27 15:27:30 +05:30
Suraj Kamath
78f1ade6c6
Update -tc flag to filter fields within the classification section ( #3606 )
...
* Add fields from Classification section in a template to the -tc flag expression evaluation
Signed-off-by: iamargus95 <kamathsuraj95@gmail.com>
* Add tests for filtering Classification section using -tc flag
Signed-off-by: iamargus95 <kamathsuraj95@gmail.com>
* Fix hyphenated Metadata keys beings added to parameters
Signed-off-by: iamargus95 <kamathsuraj95@gmail.com>
* Add tests to the fix for hyphenated fields encountered in Metadata section
Signed-off-by: iamargus95 <kamathsuraj95@gmail.com>
---------
Signed-off-by: iamargus95 <kamathsuraj95@gmail.com>
2023-04-27 00:15:35 +05:30
sandeep
fe234cf32d
version update
2023-04-20 04:44:54 +05:30
sandeep
871e7016fc
version update
2023-04-20 03:39:33 +05:30
Keith Chason
dcb003211c
Gitlab Custom Templates ( #3570 )
...
* Configuration options for GitLab template pulls
* GitLab client creation
* GitLab hooks and property renames
* Fix filesystem writing and update environment variables
* Fix type error in formatted error message
* Migrate directory config to new nucleiconfig file
* refactor + add custom templates to tm
* typo fix + only show installed ct with -tv
* add default gitlab url if not given
* fix template valid failure
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-04-20 03:12:52 +05:30
Tarun Koyalwar
bf08913cd0
update logic + config management refactor ( #3567 )
...
* adds template manager
* refactor: checkpoint
* centrailized config & template download logic
* refactor removed unused code
* use global template directory
* update related bug fixes
* bug fix create cfg dir if missing
* fix lint error
* bug fix skip writing template dir in callback
* misc update
* remove unused code
* use strings.equalfold for comparison
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-04-19 21:58:48 +05:30
Keith Chason
786ee982ed
Azure Blob Storage Custom Template Provider ( #3542 )
...
* Initial library creation for downloading blobs from Azure
* Environment variable hooks for Azure config values
* Missing configuration checks for Azure blob connection
* Package dependencies for Azure client library
* Make output directory if it doesn't exist, add log for downloaded templates
* Add example formats for Azure properties
* Add path to the output after download
* Only download .yaml files instead of also .yml .json
2023-04-17 13:48:06 +05:30
sandeep
38f448d352
Update config.go
2023-04-02 15:26:32 +05:30
Sandeep Singh
e6bd5db6fb
tlsx go mod update ( #3490 )
2023-04-02 13:40:45 +05:30
mlec
ed31fc4449
fix(links): Replace Master to Main in links 🩹 ( #3485 )
...
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-03-31 16:27:15 +05:30
Tarun Koyalwar
b1c54ef117
use paths instead of filepath for aws path
2023-03-28 20:08:24 +05:30
Tarun Koyalwar
cb5f7d06a2
debug catalog path
2023-03-27 21:23:18 +05:30
Tarun Koyalwar
f8c5a45966
add mkdir support in headless screenshot ( #3457 )
...
* add mkdir support in headless screenshot
* use filepath to join paths
* print info when screenshot is saved
* change version to v2.9.1-dev
* minor fixings on windows path
---------
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-03-24 00:44:32 +05:30
Leo Loobeek
6659402042
Initial commit for AWS Catalog ( #3372 )
2023-03-24 00:36:54 +05:30
Tarun Koyalwar
c3771e874d
fix data race in internal resultevent ( #3432 )
2023-03-16 23:20:38 +05:30
Mzack9999
c182434130
json templates support (load with flags, run & validate ) ( #3424 )
...
* extending template identification logic
* removing test code
* local debug
* json template loading support using flags
* blacklist meta json files
* minor changes
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-16 13:33:59 +05:30
sandeep
0f80575c44
Update version number and add paths to pull request.
2023-03-06 01:03:30 +05:30
xm1k3
886fdcf0a9
started move to retryablehttp
2023-03-02 14:54:01 +01:00
Notealot
aeb5dbd293
feat: add RawStringSlice / fix: reference url case insensitive ( #3346 )
...
* feat: add RawStringSlice and refactor
* restored old logic + refactor
* restored files
---------
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2023-02-26 01:17:47 +05:30
Sandeep Singh
687a481a85
Nuclei v2.8.9 release preparation ( #3281 )
...
* nuclei v2.8.9 release
* dep update
* fix go mod error
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-02-10 19:25:31 +05:30
xm1k3
1e5358b1fa
Improve passive templates error handling ( #3098 )
...
* fixes on passive templates
* Auto Generate Syntax Docs + JSONSchema [Thu Dec 29 08:47:22 UTC 2022] 🤖
* removed empty line
* warning management
When passive flag is provided we ignore all templates which are not compatible, without posting misleading errors
* removing redundant code
* skip offline errors with err var
* remove check on debug flag + used errors.Is() to check errors
important note for future refactoring: use errorsutil.Is() instead of errors.Is()
---------
Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-02-07 05:10:38 +05:30
Sandeep Singh
2a24025397
go mod + version update ( #3238 )
2023-01-24 22:58:34 +05:30
