HD Moore
0c7bade615
Remove singletons from Nuclei engine (continuation of #6210 ) ( #6296 )
...
* introducing execution id
* wip
* .
* adding separate execution context id
* lint
* vet
* fixing pg dialers
* test ignore
* fixing loader FD limit
* test
* fd fix
* wip: remove CloseProcesses() from dev merge
* wip: fix merge issue
* protocolstate: stop memguarding on last dialer delete
* avoid data race in dialers.RawHTTPClient
* use shared logger and avoid race conditions
* use shared logger and avoid race conditions
* go mod
* patch executionId into compiled template cache
* clean up comment in Parse
* go mod update
* bump echarts
* address merge issues
* fix use of gologger
* switch cmd/nuclei to options.Logger
* address merge issues with go.mod
* go vet: address copy of lock with new Copy function
* fixing tests
* disable speed control
* fix nil ExecuterOptions
* removing deprecated code
* fixing result print
* default logger
* cli default logger
* filter warning from results
* fix performance test
* hardcoding path
* disable upload
* refactor(runner): uses `Warning` instead of `Print` for `pdcpUploadErrMsg`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* Revert "disable upload"
This reverts commit 114fbe6663361bf41cf8b2645fd2d57083d53682.
* Revert "hardcoding path"
This reverts commit cf12ca800e0a0e974bd9fd4826a24e51547f7c00.
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: Dwi Siswanto <git@dw1.io>
Co-authored-by: Dwi Siswanto <25837540+dwisiswant0@users.noreply.github.com>
2025-08-02 15:56:04 +05:30
Dwi Siswanto
87ed0b2bb9
build: bump all direct modules ( #6290 )
...
* chore: fix non-constant fmt string in call
Signed-off-by: Dwi Siswanto <git@dw1.io>
* build: bump all direct modules
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore(hosterrorscache): update import path
Signed-off-by: Dwi Siswanto <git@dw1.io>
* fix(charts): break changes
Signed-off-by: Dwi Siswanto <git@dw1.io>
* build: pinned `github.com/zmap/zcrypto` to v0.0.0-20240512203510-0fef58d9a9db
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore: golangci-lint auto fixes
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore: satisfy lints
Signed-off-by: Dwi Siswanto <git@dw1.io>
* build: migrate `github.com/xanzy/go-gitlab` => `gitlab.com/gitlab-org/api/client-go`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(json): update build constraints
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore: dont panicking on close err
Signed-off-by: Dwi Siswanto <git@dw1.io>
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
2025-07-01 00:40:44 +07:00
Dwi Siswanto
695a7520b9
fix(headless): incorrect last navigated URL ( #6278 )
...
* chore(headless): uses `maps.Copy`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): implements update last navigated URL
for `ActionNavigate`, `WaitPageLifecycleEvent`, and
`WaitStable` based on latest navigation URL.
Signed-off-by: Dwi Siswanto <git@dw1.io>
* Update pkg/protocols/headless/engine/page.go
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
2025-06-24 05:32:18 +05:30
Dwi Siswanto
d2636b9ca2
feat(headless): eval DSL exprs in args ( #6017 )
...
* refactor(headless): mv `input` -> `ctx` field name
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): eval DSL exprs in args
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore(headless): rm duplicate imports
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): rm duplicate dumped req vars
* refactor(headless): unify `getTimeParameter` retrieval
Now, `getTimeParameter` tries to get the parameter
as an integer, then as a `time.Duration`, and
finally falls back to the default value
(multiplied by the unit).
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): adjust default timeout value to 5s
Signed-off-by: Dwi Siswanto <git@dw1.io>
* refactor(headless): use `getTimeParameter`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore(headless): add nolint directive - `replaceWithValues`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): revert parameter automerge & adds `inputURL` field
Signed-off-by: Dwi Siswanto <git@dw1.io>
* test(headless): add headless-dsl integration test
Signed-off-by: Dwi Siswanto <git@dw1.io>
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
2025-02-10 20:16:35 +05:30
Dwi Siswanto
2c832f5590
refactor(vardump): use godump lib ( #5676 )
...
* refactor(vardump): use `godump` lib
also increate limit char to `255`.
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(vardump): add global var `Limit`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore(protocols): rm newline
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(types): add `VarDumpLimit` option
Signed-off-by: Dwi Siswanto <git@dw1.io>
* test(vardump): add test cases
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore: tidy up mod
Signed-off-by: Dwi Siswanto <git@dw1.io>
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
2024-10-14 19:31:36 +05:30
Dwi Siswanto
4cd065df5f
feat(headless): supporting standard lifecycle events ( #5632 )
...
* refactor(headless): use `WaitStable` for `waitload` action
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): add `getNavigationFunc`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): add `WaitDOM` action
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): add `WaitFMP` action
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): add `WaitFCP` action
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): add `WaitIdle` action
Signed-off-by: Dwi Siswanto <git@dw1.io>
* refactor(headless): `ActionWaitLoad` waits for `proto.PageLifecycleEventNameLoad`
also rename `Page.WaitLoad` to `Page.WaitStable` method.
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): add `WaitStable` action
Signed-off-by: Dwi Siswanto <git@dw1.io>
* refactor(headless): supporting `duration` arg for `WaitStable` action
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore: ignore `*.png`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* test(headless): update `TestActionScreenshot*`
call `ActionWaitFMP` instead of `WaitLoad` before take screenshot
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): chained with `Timeout` when `WaitStable`
Signed-off-by: Dwi Siswanto <git@dw1.io>
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
2024-09-19 19:01:12 +05:30
Dwi Siswanto
841d8913e5
feat(headless): add ActionWaitDialog type ( #5545 )
...
* feat(headless): add `dialog` action type
also implement it
Signed-off-by: Dwi Siswanto <git@dw1.io>
* refactor(headless): add `ActionData` for action output datas
Signed-off-by: Dwi Siswanto <git@dw1.io>
* refactor(headless): rm `value` arg for `*Page.HandleDialog`
also:
* expose `err` from \*proto.PageHandleJavaScriptDialog`
* conditional ActionData assignment based on
Signed-off-by: Dwi Siswanto <git@dw1.io>
* refactor(headless): rename to `ActionWaitDialog`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* test(headless): fix mismatch assertion of `src` output of `ActionGetResource`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* test(headless): add TestActionWaitDialog test case
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): add `GetActionDataWithDefault` generic func
Signed-off-by: Dwi Siswanto <git@dw1.io>
* feat(headless): implement `GetActionDataWithDefault`
to `header` & `status_code`
Signed-off-by: Dwi Siswanto <git@dw1.io>
* refactor(headless): use `mapsutil.Map` instead
Signed-off-by: Dwi Siswanto <git@dw1.io>
* Revert "feat(headless): add `GetActionDataWithDefault` generic func"
This reverts commit fa12e0d6a221c8a7bf62200f69814ee27681f08f.
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
2024-09-02 15:29:52 +05:30
Dwi Siswanto
e0b2542868
feat: conditionally panic-recover ( #5553 )
...
* feat: conditionally panic-recover
As discussed with @Mzack9999, we should avoid
overusing panic-recover. We need to review the RCA
first to determine whether this is an exceptional
situation or if it's a higher-level function meant
to recover from a panic. This approach will help
us establish a robust error-handling strategy.
The implementation of panic-recover should be
conditional and NOT applied when running in a CI
environment AND IS temporary. Once we've caught
all errors and made the necessary corrections, we
can remove the deferred recover function.
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore(deps): bump `go-ci` to v1.0.2
Signed-off-by: Dwi Siswanto <git@dw1.io>
* chore(make): add `-race` to `GOFLAGS` in `test`
Signed-off-by: Dwi Siswanto <git@dw1.io>
---------
Signed-off-by: Dwi Siswanto <git@dw1.io>
2024-08-28 17:57:45 +05:30
Tarun Koyalwar
23bd0336fb
multiple bug fixes + performance improvements ( #5148 )
...
* prototype errkit
* complete errkit implementation
* add cause to all timeouts
* fix request timeout annotation @timeout
* increase responseHeaderTimeout to 8 for stability
* rawhttp error related improvements
* feat: add port status caching
* add port status caching to http
* migrate to new utils/errkit
* remote dialinterface + error cause
* debug dir support using .gitignore debug-*
* make nuclei easy to debug
* debug dir update .gitignore
* temp change (to revert)
* Revert "temp change (to revert)"
This reverts commit d3131f777713b9f80e2275142e80f36340a76d36.
* use available context instead of new one
* bump fastdialer
* fix hosterrorscache + misc improvements
* add 'address' field in error log
* fix js vague errors + pgwrap driver
* fix max host error + misc updates
* update tests as per changes
* fix request annotation context
* remove closed dialer reference
* fix sdk panic issue
* bump retryablehttp-go,utils,fastdialer
---------
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2024-05-25 00:29:04 +05:30
Mzack9999
a8d1393e96
init- using resizable components
2024-04-03 17:50:57 +02:00
Tarun Koyalwar
f663d1c9cf
deprecate(remove): file write in extractor using to ( #4565 )
...
* fix race-condition & oow in extracted file output
* add mutex for file.Write + set finalizer for os.File
* fix integration test
* disable extractor save to file in lib mode(configurable)
* use sync.Once for init
* disable out of bound image write in headless
* misc updates
* fix headless screenshot test
* fix extractor save to file integration test
* remove 'to' feature in extractors
2024-01-05 03:23:08 +05:30
Tarun Koyalwar
47e75038f0
headless: fix panic + refactor waitevent action ( #4465 )
...
* fix waitEvent action
* avoid future panics
* integration test + bug fix
* headless: add max-duration support in waitevent
* fix comment + max-duration input
2023-12-06 19:08:26 +05:30
Tarun Koyalwar
dc44105baf
nuclei v3 : misc updates ( #4247 )
...
* use parsed options while signing
* update project layout to v3
* fix .gitignore
* remove example template
* misc updates
* bump tlsx version
* hide template sig warning with env
* js: retain value while using log
* fix nil pointer derefernce
* misc doc update
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-10-17 17:44:13 +05:30
