External/signoz
1
0
Fork 0
mirror of https://github.com/SigNoz/signoz.git synced 2025-12-17 15:36:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,069 Commits 353 Branches 648 Tags
Commit Graph

120 Commits

Author SHA1 Message Date
Srikanth Chekuri
bd02848623
chore: add sql migration for dashboards, alerts, and saved views (#8642) 
## 📄 Summary

To reliably migrate the alerts and dashboards, we need access to the telemetrystore to fetch some metadata and while doing migration, I need to log some stuff to fix stuff later.

Key changes:
- Modified the migration to include telemetrystore and a logging provider (open to using a standard logger instead)
- To avoid the previous issues with imported dashboards failing during migration, I've ensured that imported JSON files are automatically transformed when migration is active
- Implemented detailed logic to handle dashboard migration cleanly and prevent unnecessary errors
- Separated the core migration logic from SQL migration code, as users from the dot metrics migration requested shareable code snippets for local migrations. This modular approach allows others to easily reuse the migration functionality.

Known: I didn't register the migration yet in this PR, and will not merge this yet, so please review with that in mid.
 2025-08-06 23:05:39 +05:30
Vibhu Pandey
ebb2f1fd63
feat(cmd): add cmd package (#8535) 2025-07-17 10:38:31 +00:00
Piyush Singariya
d6eed8e79d
feat: JSON Flattening in logs pipelines (#8227) 
* feat: introducing JSON Flattening

* fix: removed bug and tested

* test: removed testing test

* feat: additional severity levels, and some clearing

* chore: minor changes

* test: added tests for processJSONParser

* test: added check for OnError

* fix: review from ellipsis

* fix: variablise max flattening depth

* Update pkg/query-service/app/logparsingpipeline/pipelineBuilder.go

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* Update pkg/errors/errors.go

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* fix: quoted JSON strings fix

* test: updating otel collector for testing

* test: update collector's reference

* chore: change with new error package

* chore: set flattening depth equal to 1

* fix: fallback for depth

* fix: change in errors package

* fix: tests

* fix: test

* chore: update collector version

* fix: go.sum

---------

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Nityananda Gohain <nityanandagohain@gmail.com>
 2025-07-14 18:48:01 +05:30
dependabot[bot]
d4e373443b
chore(deps): bump github.com/go-viper/mapstructure/v2 (#8379) 
Bumps [github.com/go-viper/mapstructure/v2](https://github.com/go-viper/mapstructure) from 2.2.1 to 2.3.0.
- [Release notes](https://github.com/go-viper/mapstructure/releases)
- [Changelog](https://github.com/go-viper/mapstructure/blob/main/CHANGELOG.md)
- [Commits](https://github.com/go-viper/mapstructure/compare/v2.2.1...v2.3.0)

---
updated-dependencies:
- dependency-name: github.com/go-viper/mapstructure/v2
  dependency-version: 2.3.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
 2025-07-04 02:40:14 +00:00
Srikanth Chekuri
6cb7f152e1
chore: bump opamp-go version (#8310) 2025-06-26 15:01:17 +05:30
Vibhu Pandey
fbcff29fae
chore(sqlstore): remove sqlx (#8306) 
## 📄 Summary

remove sqlx
 2025-06-20 00:34:54 +05:30
Piyush Singariya
01036a8a2f
fix: top level keys EXIST and NOTEXIST filter simulation (#8255) 
* fix: top level keys EXIST and NOTEXIST filter simulation

* test: fix tests

* test: temporarily change collector version

* test: updating go.mod

* fix: tests

* chore: revert changes

* chore: update collector's reference to stable version
 2025-06-17 11:28:40 +05:30
Vibhu Pandey
ba0ba4bbc9
build(go): upgrade purego to v0.8.4 (#8159) 2025-06-05 12:31:49 +00:00
Vikrant Gupta
3bb9e05681
chore(dashboard): make dashboard schema production ready (#8092) 
* chore(dashboard): intial commit

* chore(dashboard): bring all the code in module

* chore(dashboard): remove lock unlock from ee codebase

* chore(dashboard): go deps

* chore(dashboard): fix lint

* chore(dashboard): implement the store

* chore(dashboard): add migration

* chore(dashboard): fix lint

* chore(dashboard): api and frontend changes

* chore(dashboard): frontend changes for new dashboards

* chore(dashboard): fix test cases

* chore(dashboard): add lock unlock APIs

* chore(dashboard): add lock unlock APIs

* chore(dashboard): move integrations controller out from module

* chore(dashboard): move integrations controller out from module

* chore(dashboard): move integrations controller out from module

* chore(dashboard): rename migration file

* chore(dashboard): surface errors for lock/unlock dashboard

* chore(dashboard): some testing cleanups

* chore(dashboard): fix postgres migrations

---------

Co-authored-by: Vibhu Pandey <vibhupandey28@gmail.com>
 2025-06-02 22:41:38 +05:30
Piyush Singariya
81b8f93177
chore: remove unnecessary dependency (#7938) 2025-05-14 15:40:25 +05:30
Vibhu Pandey
96cfb607d1
chore(go): add go-deps workflow (#7936) 
* feat(go): add go-deps workflow

* chore(go): fix dependencies
 2025-05-14 09:00:53 +00:00
Vibhu Pandey
02b605d109
feat(analytics): add analytics package (#7808) 
- add analytics package
 2025-05-12 14:32:13 +05:30
Vibhu Pandey
59af9d1c2f
chore(go): upgrade to 1.23 (#7885) 2025-05-11 14:09:24 +05:30
Srikanth Chekuri
a9c09f33cb
chore: always add reserved vars (#7689) 2025-04-23 09:14:10 +00:00
Piyush Singariya
a42eacec4b
chore: enhancing JSON Parser handling (#7591) 
* feat: enhancing JSON Parser handling

* fix: updating collector version

* chore: updating go.mod reference for Collector

---------

Co-authored-by: Nityananda Gohain <nityanandagohain@gmail.com>
 2025-04-16 11:24:59 +05:30
Srikanth Chekuri
8ff05b2e8f
chore: add field type definitions for qb v5 (#7552) 2025-04-08 22:34:58 +05:30
Srikanth Chekuri
c8c56c544e
chore: add generated parser files for go (#7538) 2025-04-08 13:52:40 +00:00
dependabot[bot]
2748b49a44
chore(deps): bump github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 (#7401) 
Bumps [github.com/golang-jwt/jwt/v5](https://github.com/golang-jwt/jwt) from 5.2.1 to 5.2.2.
- [Release notes](https://github.com/golang-jwt/jwt/releases)
- [Changelog](https://github.com/golang-jwt/jwt/blob/main/VERSION_HISTORY.md)
- [Commits](https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2)

---
updated-dependencies:
- dependency-name: github.com/golang-jwt/jwt/v5
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
 2025-04-05 01:43:43 +00:00
Vibhu Pandey
68f874e433
chore(ff): remove unused SMART_TRACE_DETAIL feature flag (#7527) 2025-04-04 20:28:54 +05:30
dependabot[bot]
b43a198fd8
chore(deps): bump github.com/expr-lang/expr from 1.16.9 to 1.17.0 (#7342) 
Bumps [github.com/expr-lang/expr](https://github.com/expr-lang/expr) from 1.16.9 to 1.17.0.
- [Release notes](https://github.com/expr-lang/expr/releases)
- [Commits](https://github.com/expr-lang/expr/compare/v1.16.9...v1.17.0)

---
updated-dependencies:
- dependency-name: github.com/expr-lang/expr
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
 2025-04-03 08:17:40 +00:00
Vibhu Pandey
81c7f3221a
feat(prometheus): create a dedicated prometheus package (#7397) 2025-03-31 14:11:11 +00:00
Vibhu Pandey
027a1631ef
feat(httpclient): add an extensible http client (#7446) 2025-03-26 19:33:52 +00:00
Srikanth Chekuri
88be23c3e3
chore: pass through substitutions for CH query (#7389) 2025-03-26 12:58:55 +00:00
Vibhu Pandey
089f128020
chore: remove otlp zap encoder (#7408) 2025-03-23 11:49:37 +05:30
Shivanshu Raj Shrivastava
efd4e30edf
fix: publish signoz as package (#7378) 
Signed-off-by: Shivanshu Raj Shrivastava <shivanshu1333@gmail.com>
 2025-03-20 15:31:41 +00:00
aniketio-ctrl
5b6b5bf359
feat(summary): added update metrics metadata api (#7235) 
* feat(explorer): updated metadata metrics api| 7076

* feat(explorer): added inspect metrics with resource attribute| 7076

* fix(summary): fixed dashboard name in metric metadata api

* fix(summary): removed offset from second query

* fix(summary): removed offset from second query

* feat(summary): added update metrics metadata api

* feat(summary): resolved log messages

* feat(summary): added is_monotonic column and added temporality| 7077

* feat(summary): added histogram bucket and summary quantile check| 7077

* feat(summary): added temporality and is_monotonic in update queries| 7077

* feat(summary): resolved pr comments| 7077

* feat(inspect): normalized resource attributes

* feat(update-summary): merge conflicts resolve

* feat(update-summary): merge conflicts resolve

* feat(update-metrics): updated description check

* feat(update-metrics): added kv log comments

* fix: updated testcase with reader

* fix: updated testcase with reader

* fix: updated testcase with reader

* fix: updated normalized true in metrics explorer api

* fix: removed inner join from list metrics query
 2025-03-18 10:39:34 +00:00
Vibhu Pandey
1f33928bf9
feat(alertmanager): integrate with ruler (#7222) 
### Summary

Integrate the new implementations of the alertmanager along with changes to the ruler. This change can be broadly categoried into 3 parts:

#### Frontend
- The earlier `/api/v1/alerts` api was double encoding the response in json and sending it to the frontend. This PR fixes the json response object. 

For instance, we have gone from the response `{
    "status": "success",
    "data": "{\"status\":\"success\",\"data\":[{\"labels\":{\"alertname\":\"[platform][consumer] consumer is above 100% memory utilization\",\"bu\":\"platform\",\"......
}` to the response `{"status":"success","data":[{"labels":{"alertname":"[Metrics] Pod CP......`

- `msteams` has been changed to `msteamsv2` wherever applicable

#### Ruler
The following changes have been done in the ruler component:

- Removal of the old alertmanager and notifier
- The RuleDB methods `Create`, `Edit` and `Delete` have been made transactional
- Introduction of a new `testPrepareNotifyFunc` for sending test notifications
- Integration with the new alertmanager

#### Alertmanager
Although a huge chunk of the alertmanagers have been merged in previous PRs (the list can be found at https://github.com/SigNoz/platform-pod/issues/404), this PR takes care of changes needed in order to incorporate it with the ruler

- Addition of ruleId based matching
- Support for marshalling the global configuration directly from the upstream alertmanager
- Addition of orgId to the legacy alertmanager
- Support for always adding defaults to both routes and receivers while creating them
- Migration to create the required alertmanager tables
- Migration for msteams to msteamsv2 has been added. We will start using msteamv2 config for the new alertmanager and keep using msteams for the old one.

#### Related Issues / PR's

Closes https://github.com/SigNoz/platform-pod/issues/404
Closes https://github.com/SigNoz/platform-pod/issues/176
 2025-03-09 20:00:42 +00:00
dependabot[bot]
42f7511e06
chore(deps): bump github.com/go-jose/go-jose/v4 from 4.0.2 to 4.0.5 (#7180) 
Bumps [github.com/go-jose/go-jose/v4](https://github.com/go-jose/go-jose) from 4.0.2 to 4.0.5.
- [Release notes](https://github.com/go-jose/go-jose/releases)
- [Changelog](https://github.com/go-jose/go-jose/blob/main/CHANGELOG.md)
- [Commits](https://github.com/go-jose/go-jose/compare/v4.0.2...v4.0.5)

---
updated-dependencies:
- dependency-name: github.com/go-jose/go-jose/v4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-03-07 03:12:55 +00:00
Vibhu Pandey
8a01312967
feat(alertmanager): simplify and test e2e alertmanager (#7217) 
* refactor(alertmanager): complete e2e testing and simplify

* fix(alertmanager): fix typo

* fix(alertmanager): set to true for prometheus
 2025-03-05 10:01:02 +05:30
Srikanth Chekuri
a26cdf1089
chore: bump github.com/SigNoz/prometheus (#7182) 2025-03-03 08:34:16 +00:00
aniketio-ctrl
972a7a9dac
feat(summary-view): add summary view endpoints 2025-02-20 13:49:44 +05:30
Nityananda Gohain
c3951afdfd
fix: refactor auth package (#7110) 
* fix: refactor auth package

* fix: minor changes

* fix: refactor jwt

* fix: add tests and address comments

* fix: address comments

* fix: add uncomitted file

* fix: address comments

* fix: update tests
 2025-02-17 18:16:41 +05:30
Vibhu Pandey
a6cfb63036
fix(alertmanager): fix a flaky test (#7123) 2025-02-16 19:02:33 +05:30
Vibhu Pandey
bcf7bf38fc
feat(alertmanager): add alertmanagertypes (#7101) 
add alertmanagertypes
 2025-02-12 17:23:18 +00:00
Nityananda Gohain
7a03a09ac1
fix: add migration and postgres provider (#7089) 
* fix: move migrations to bun

* fix: use anonymous structs and move modes to types package

* fix: minor changes after tests

* fix: remove bun relations and add foreign keys

* fix: minor changes

* Update pkg/types/agent.go

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* fix: add migration and postgres provider

* fix: address minor comments

* fix: use bun create index

* fix: add migration

* fix: support for postgres in migrations

* Update pkg/sqlstore/pgstore/provider.go

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* Update pkg/sqlmigration/001_add_organization.go

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* fix: address comments

* fix: move max connection to base config

* fix: update scope

---------

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
 2025-02-12 13:23:40 +00:00
Vibhu Pandey
dc15ee8176
feat(sqlmigration): consolidate all sqlmigrations into one package (#7018) 
* feat(sqlmigration): add sqlmigrations

* feat(sqlmigration): test sqlmigrations

* feat(sqlmigration): add remaining factories

* feat(sqlmigration): consolidate into single package

* fix(telemetrystore): remove existing env variables

* fix(telemetrystore): fix DSN
 2025-02-04 09:23:36 +00:00
Vibhu Pandey
001122db2c
feat(instrumentation): adopt slog (#6907) 
### Summary

feat(instrumentation): adopt slog
 2025-01-24 09:23:02 +00:00
Vibhu Pandey
0cf9003e3a
feat(.): initialize all factories (#6844) 
### Summary

feat(.): initialize all factories

#### Related Issues / PR's

Removed all redundant commits of https://github.com/SigNoz/signoz/pull/6843
Closes https://github.com/SigNoz/signoz/pull/6782
 2025-01-20 17:45:33 +05:30
Vibhu Pandey
c574adc634
feat(sqlstore): add sqlstore package (#6835) 
### Summary

Add `sqlstore` package
 2025-01-17 15:54:48 +05:30
dependabot[bot]
dbe78e55a9
chore(deps): bump golang.org/x/net from 0.29.0 to 0.33.0 (#6820) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-01-14 15:06:51 +00:00
Eng Zer Jun
03fb388cd1
chore(deps): update cespare/xxhash to v2 version (#6714) 2024-12-30 11:13:14 +00:00
Prashant Shahi
6d9741c3a4
chore(signoz): pin versions: SigNoz 0.63.0, SigNoz OtelCollector 0.111.16 
Signed-off-by: Prashant Shahi <prashant@signoz.io>
 2024-12-18 15:25:20 +05:30
Prashant Shahi
610a8ec704 Merge branch 'main' into release/v0.63.x 2024-12-18 15:07:57 +05:30
dependabot[bot]
e3caa6a8f5
chore(deps): bump golang.org/x/crypto from 0.27.0 to 0.31.0 (#6638) 
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.27.0 to 0.31.0.
- [Commits](https://github.com/golang/crypto/compare/v0.27.0...v0.31.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-12-14 04:29:25 +00:00
Prashant Shahi
a9440c010c
chore(signoz): pin versions: SigNoz 0.62.0, SigNoz OtelCollector 0.111.15 
Signed-off-by: Prashant Shahi <prashant@signoz.io>
 2024-12-12 15:28:09 +05:30
Prashant Shahi
99367be850
chore(signoz): pin versions: SigNoz 0.61.0, SigNoz OtelCollector 0.111.14 
Signed-off-by: Prashant Shahi <prashant@signoz.io>
 2024-12-04 16:21:39 +05:30
Prashant Shahi
7cd8442e6e
chore(signoz): pin versions: SigNoz 0.60.0, SigNoz OtelCollector 0.111.13 
Signed-off-by: Prashant Shahi <prashant@signoz.io>
 2024-11-27 15:13:08 +05:30
Prashant Shahi
5a70123b06
chore(signoz): pin versions: SigNoz 0.59.0, SigNoz OtelCollector 0.111.9 
Signed-off-by: Prashant Shahi <prashant@signoz.io>
 2024-11-20 16:45:18 +05:30
Prashant Shahi
48f3b9cacb
chore(signoz): pin versions: SigNoz 0.58.0, SigNoz OtelCollector 0.111.8 
Signed-off-by: Prashant Shahi <prashant@signoz.io>
 2024-11-08 16:02:59 +05:30
Raj Kamal Singh
4e26189778
Chore: bump signoz otel collector dependency to 0.111.5 (#6302) 
* chore: bump signoz-otel-collector dependency version to 0.111.5

* chore: logs filter suggestions: update import for ResourceHierarchy from signoz-otel-collector
 2024-10-28 21:23:47 +05:30