-
Notifications
You must be signed in to change notification settings - Fork 3.8k
Open
Labels
Description
Is there an existing issue for this?
- I have searched the existing issues
What happened?
Description
If I configure a rocketchatConfigs receiver within an AlertmanagerConfig there is still a channel present, but within the generated alertmanager configuration the channel is missing which lead to an invalid receiver because of the lack of the channel.
Steps to Reproduce
kind create cluster --name alertmanager-config
kubectl create namespace prometheus-operator
kubectl create secret generic alertmanager-rocketchat --namespace prometheus-operator --from-literal=username=dummy --from-literal=password=p455w0rd
helm upgrade kube-prometheus-stack oci://ghcr.io/prometheus-community/charts/kube-prometheus-stack --install --namespace prometheus-operator --values - << EOF
alertmanager:
config:
receivers:
- name: "null"
- name: "rocketchat-inline"
rocketchat_configs:
- send_resolved: true
channel: '#dummy'
token_id: dummy
token: p455w0rd
EOF
kubectl apply --namespace prometheus-operator -f - << EOF
apiVersion: monitoring.coreos.com/v1alpha1
kind: AlertmanagerConfig
metadata:
name: rocketchat
spec:
route:
groupBy:
- job
receiver: rocketchat-config
matchers:
- name: rocketchat
value: config
receivers:
- name: rocketchat-config
rocketchatConfigs:
- sendResolved: true
channel: '#dummy'
tokenID:
name: alertmanager-rocketchat
key: username
token:
name: alertmanager-rocketchat
key: password
EOF
❯ kubectl get alertmanagerconfig rocketchat --namespace prometheus-operator -o yaml | yq '.spec.receivers[0]'
name: rocketchat-config
rocketchatConfigs:
- channel: '#dummy'
sendResolved: true
token:
key: password
name: alertmanager-rocketchat
tokenID:
key: username
name: alertmanager-rocketchat
❯ kubectl get secrets alertmanager-kube-prometheus-stack-alertmanager-generated --namespace prometheus-operator -o jsonpath='{.data.alertmanager\.yaml\.gz}' | base64 --decode | gunzip | yq '.receivers[2]'
name: prometheus-operator/rocketchat/rocketchat-config
rocketchat_configs:
- send_resolved: true
token_id: dummy
token: p455w0rd
short_fields: false
link_names: false
Expected Result
Having the channel attribute within the alertmanager-kube-prometheus-stack-alertmanager-generated secret.
Actual Result
Lacking the required channel name within alertmanager-kube-prometheus-stack-alertmanager-generated secret.
Prometheus Operator Version
Name: kube-prometheus-stack-operator
Namespace: prometheus-operator
CreationTimestamp: Thu, 09 Oct 2025 14:13:56 +0200
Labels: app=kube-prometheus-stack-operator
app.kubernetes.io/component=prometheus-operator
app.kubernetes.io/instance=kube-prometheus-stack
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=kube-prometheus-stack-prometheus-operator
app.kubernetes.io/part-of=kube-prometheus-stack
app.kubernetes.io/version=77.14.0
chart=kube-prometheus-stack-77.14.0
heritage=Helm
release=kube-prometheus-stack
Annotations: deployment.kubernetes.io/revision: 1
meta.helm.sh/release-name: kube-prometheus-stack
meta.helm.sh/release-namespace: prometheus-operator
Selector: app=kube-prometheus-stack-operator,release=kube-prometheus-stack
Replicas: 1 desired | 1 updated | 1 total | 1 available | 0 unavailable
StrategyType: RollingUpdate
MinReadySeconds: 0
RollingUpdateStrategy: 25% max unavailable, 25% max surge
Pod Template:
Labels: app=kube-prometheus-stack-operator
app.kubernetes.io/component=prometheus-operator
app.kubernetes.io/instance=kube-prometheus-stack
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=kube-prometheus-stack-prometheus-operator
app.kubernetes.io/part-of=kube-prometheus-stack
app.kubernetes.io/version=77.14.0
chart=kube-prometheus-stack-77.14.0
heritage=Helm
release=kube-prometheus-stack
Service Account: kube-prometheus-stack-operator
Containers:
kube-prometheus-stack:
Image: quay.io/prometheus-operator/prometheus-operator:v0.85.0
Port: 10250/TCP
Host Port: 0/TCP
Args:
--kubelet-service=kube-system/kube-prometheus-stack-kubelet
--kubelet-endpoints=true
--kubelet-endpointslice=false
--localhost=127.0.0.1
--prometheus-config-reloader=quay.io/prometheus-operator/prometheus-config-reloader:v0.85.0
--config-reloader-cpu-request=0
--config-reloader-cpu-limit=0
--config-reloader-memory-request=0
--config-reloader-memory-limit=0
--thanos-default-base-image=quay.io/thanos/thanos:v0.39.2
--secret-field-selector=type!=kubernetes.io/dockercfg,type!=kubernetes.io/service-account-token,type!=helm.sh/release.v1
--web.enable-tls=true
--web.cert-file=/cert/cert
--web.key-file=/cert/key
--web.listen-address=:10250
--web.tls-min-version=VersionTLS13
Liveness: http-get https://:https/healthz delay=0s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get https://:https/healthz delay=0s timeout=1s period=10s #success=1 #failure=3
Environment:
GOGC: 30
Mounts:
/cert from tls-secret (ro)
Volumes:
tls-secret:
Type: Secret (a volume populated by a Secret)
SecretName: kube-prometheus-stack-admission
Optional: false
Node-Selectors: <none>
Tolerations: <none>
Conditions:
Type Status Reason
---- ------ ------
Available True MinimumReplicasAvailable
Progressing True NewReplicaSetAvailable
OldReplicaSets: <none>
NewReplicaSet: kube-prometheus-stack-operator-645b79c648 (1/1 replicas created)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal ScalingReplicaSet 12m deployment-controller Scaled up replica set kube-prometheus-stack-operator-645b79c648 from 0 to 1Kubernetes Version
clientVersion:
buildDate: "1980-01-01T00:00:00Z"
compiler: gc
gitCommit: 74cdb4273add43f53ddcad2de8ea9fd93c810dc4
gitTreeState: archive
gitVersion: v1.33.4
goVersion: go1.24.6
major: "1"
minor: "33"
platform: darwin/arm64
kustomizeVersion: v5.6.0
serverVersion:
buildDate: "2025-08-27T10:09:04Z"
compiler: gc
emulationMajor: "1"
emulationMinor: "34"
gitCommit: f28b4c9efbca5c5c0af716d9f2d5702667ee8a45
gitTreeState: clean
gitVersion: v1.34.0
goVersion: go1.24.6
major: "1"
minCompatibilityMajor: "1"
minCompatibilityMinor: "33"
minor: "34"
platform: linux/arm64Kubernetes Cluster Type
kind
How did you deploy Prometheus-Operator?
helm chart:prometheus-community/kube-prometheus-stack
Manifests
prometheus-operator log output
ts=2025-10-09T12:13:56.968913681Z level=info caller=/workspace/cmd/operator/main.go:218 msg="Starting Prometheus Operator" version="(version=0.85.0, branch=, revision=2ed4172)" build_context="(go=go1.24.6, platform=linux/arm64, user=, date=20250821-12:40:32, tags=unknown)" feature_gates="PrometheusAgentDaemonSet=false,PrometheusShardRetentionPolicy=false,PrometheusTopologySharding=false,StatusForConfigurationResources=false"
ts=2025-10-09T12:13:56.968988036Z level=info caller=/workspace/cmd/operator/main.go:219 msg="Operator's configuration" watch_referenced_objects_in_all_namespaces=false controller_id="" enable_config_reloader_probes=false
ts=2025-10-09T12:13:56.969138914Z level=info caller=/workspace/internal/goruntime/cpu.go:27 msg="Leaving GOMAXPROCS=11: CPU quota undefined"
ts=2025-10-09T12:13:56.969205683Z level=info caller=/workspace/cmd/operator/main.go:233 msg="Namespaces filtering configuration " config="{allow_list=\"\",deny_list=\"\",prometheus_allow_list=\"\",alertmanager_allow_list=\"\",alertmanagerconfig_allow_list=\"\",thanosruler_allow_list=\"\"}"
ts=2025-10-09T12:13:56.973972339Z level=info caller=/workspace/cmd/operator/main.go:274 msg="connection established" kubernetes_version=1.34.0
ts=2025-10-09T12:13:56.97794622Z level=info caller=/workspace/cmd/operator/main.go:359 msg="Kubernetes API capabilities" endpointslices=true
ts=2025-10-09T12:13:56.99281223Z level=warn caller=/workspace/pkg/server/server.go:158 msg="server TLS client verification disabled" client_ca_file=/etc/tls/private/tls-ca.crt err="stat /etc/tls/private/tls-ca.crt: no such file or directory"
ts=2025-10-09T12:13:56.99321735Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=alertmanager
ts=2025-10-09T12:13:56.993291997Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:56.993300999Z level=info caller=/workspace/pkg/kubelet/controller.go:214 msg="Starting controller" component=kubelet_endpoints kubelet_object=kube-system/kube-prometheus-stack-kubelet
ts=2025-10-09T12:13:56.993362559Z level=info caller=/workspace/pkg/server/server.go:295 msg="starting secure server" address=[::]:10250 http2=false
ts=2025-10-09T12:13:56.993427495Z level=info caller=/go/pkg/mod/k8s.io/apiserver@v0.33.3/pkg/server/dynamiccertificates/tlsconfig.go:243 msg="Starting DynamicServingCertificateController"
ts=2025-10-09T12:13:56.993552449Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:56.994230065Z level=info caller=/go/pkg/mod/k8s.io/apiserver@v0.33.3/pkg/server/dynamiccertificates/dynamic_serving_content.go:135 msg="Starting controller" name=servingCert::/cert/cert::/cert/key
ts=2025-10-09T12:13:56.993565452Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=thanos
ts=2025-10-09T12:13:57.019581377Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.020501523Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:13:57.0217218Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:13:57.094663399Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094744757Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094754176Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094771139Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094775891Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094781059Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094783018Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094789061Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094796939Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094817153Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094823446Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094827531Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.09483024Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094837242Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094843286Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094846787Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094848579Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094851163Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheusagent
ts=2025-10-09T12:13:57.094852872Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheusagent
ts=2025-10-09T12:13:57.094856873Z level=info caller=/workspace/pkg/prometheus/agent/operator.go:488 msg="successfully synced all caches" component=prometheusagent-controller
ts=2025-10-09T12:13:57.09502884Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095067644Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095073395Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095081606Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095087399Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095091567Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095095235Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095117742Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095128453Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095150335Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095172883Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095196056Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095215145Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095225607Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095234526Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095239069Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095241486Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095244946Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095258491Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.09526887Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=prometheus
ts=2025-10-09T12:13:57.095274663Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=prometheus
ts=2025-10-09T12:13:57.095289667Z level=info caller=/workspace/pkg/prometheus/server/operator.go:439 msg="successfully synced all caches" component=prometheus-controller
ts=2025-10-09T12:13:57.096176929Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=alertmanager
ts=2025-10-09T12:13:57.096238406Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=alertmanager
ts=2025-10-09T12:13:57.096267456Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=alertmanager
ts=2025-10-09T12:13:57.096325848Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=alertmanager
ts=2025-10-09T12:13:57.096368027Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=alertmanager
ts=2025-10-09T12:13:57.096396827Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=alertmanager
ts=2025-10-09T12:13:57.096434172Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=alertmanager
ts=2025-10-09T12:13:57.096489896Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=alertmanager
ts=2025-10-09T12:13:57.096532367Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=alertmanager
ts=2025-10-09T12:13:57.096577422Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=alertmanager
ts=2025-10-09T12:13:57.096630688Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=alertmanager
ts=2025-10-09T12:13:57.096648276Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=alertmanager
ts=2025-10-09T12:13:57.096692706Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=alertmanager
ts=2025-10-09T12:13:57.09672359Z level=info caller=/workspace/pkg/alertmanager/operator.go:367 msg="successfully synced all caches" component=alertmanager-controller
ts=2025-10-09T12:13:57.096341686Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:13:57.097422421Z level=info caller=/workspace/pkg/alertmanager/operator.go:722 msg="StatefulSet not found" component=alertmanager-controller key=prometheus-operator/alertmanager-kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.097822373Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.099861724Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=thanos
ts=2025-10-09T12:13:57.103130439Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=thanos
ts=2025-10-09T12:13:57.103151445Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=thanos
ts=2025-10-09T12:13:57.103160656Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=thanos
ts=2025-10-09T12:13:57.103163073Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=thanos
ts=2025-10-09T12:13:57.103166699Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=thanos
ts=2025-10-09T12:13:57.103170284Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=thanos
ts=2025-10-09T12:13:57.103173535Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=thanos
ts=2025-10-09T12:13:57.103175952Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=thanos
ts=2025-10-09T12:13:57.103180662Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:350 msg="Waiting for caches to sync" controller=thanos
ts=2025-10-09T12:13:57.103182537Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/tools/cache/shared_informer.go:357 msg="Caches are synced" controller=thanos
ts=2025-10-09T12:13:57.103186372Z level=info caller=/workspace/pkg/thanos/operator.go:318 msg="successfully synced all caches" component=thanos-controller
ts=2025-10-09T12:13:57.14011514Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.140236092Z level=info caller=/workspace/pkg/alertmanager/operator.go:722 msg="StatefulSet not found" component=alertmanager-controller key=prometheus-operator/alertmanager-kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.145224647Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.template.spec.containers[1].ports[0]: duplicate port name \"reloader-web\" with spec.template.spec.initContainers[0].ports[0], services and probes that select ports by name will use spec.template.spec.initContainers[0].ports[0]"
ts=2025-10-09T12:13:57.146179887Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.146503274Z level=info caller=/workspace/pkg/alertmanager/operator.go:722 msg="StatefulSet not found" component=alertmanager-controller key=prometheus-operator/alertmanager-kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.14662306Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.161587182Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.template.spec.containers[1].ports[0]: duplicate port name \"reloader-web\" with spec.template.spec.initContainers[0].ports[0], services and probes that select ports by name will use spec.template.spec.initContainers[0].ports[0]"
ts=2025-10-09T12:13:57.161884728Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:13:57.220461424Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.234069271Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.23661173Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.245722209Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:13:57.261492194Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.261897897Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.292404062Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.305484171Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.333553409Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.333827615Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.333963405Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:13:57.337397834Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.363601647Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.40301494Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.427741942Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.428137184Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:13:57.43128157Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.43232221Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.457652766Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.542700561Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.589925658Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.5902365Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.590304645Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:13:57.590660584Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.639502908Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.679169734Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.714251666Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.715248126Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:13:57.726659576Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.727124463Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:13:57.746790305Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:13:57.854988138Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:14:29.668927743Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:14:29.682827385Z level=info caller=/workspace/pkg/prometheus/server/operator.go:832 msg="sync prometheus" component=prometheus-controller key=prometheus-operator/kube-prometheus-stack-prometheus
ts=2025-10-09T12:14:29.69560603Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:14:29.696061956Z level=info caller=/workspace/pkg/alertmanager/operator.go:603 msg="sync alertmanager" component=alertmanager-controller key=prometheus-operator/kube-prometheus-stack-alertmanager
ts=2025-10-09T12:14:29.715069729Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:14:29.758044198Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:16:57.007961561Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:16:57.009809517Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:16:57.011629259Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:19:57.006306159Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:19:57.008150657Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:19:57.010256305Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:22:57.010066586Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:22:57.011957Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:22:57.014566623Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:25:57.010802362Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: spec.SessionAffinity is ignored for headless services"
ts=2025-10-09T12:25:57.012920917Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"
ts=2025-10-09T12:25:57.015380392Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.33.3/rest/warnings.go:110 msg="Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice"Anything else?
No response
dmaes