666 questions
0
votes
1
answer
84
views
Laravel logs show incorrect severity levels in Google Cloud Logging
I’m running a Laravel application using the dunglas/frankenphp:1.9-php8.4-alpine Docker image and deploying it on Kubernetes. Logs are written to stderr and collected by Google Cloud’s built-in per-...
0
votes
0
answers
65
views
Tracking Speech-to-Text usage per client with gRPC custom metadata in Google Cloud Logs
I am implementing a system using Google Cloud Speech-to-Text (STT) services via gRPC streams and need a reliable way to track usage per client for quota management. I want Google Cloud's logging ...
0
votes
1
answer
119
views
Google Cloud log-based alert policy not triggering any incidents
I’m having trouble getting a log-based alert policy to work in Google Cloud Monitoring. I can see the logs in the Logs Explorer and the filter seems to match correctly, but the alert never triggers ...
3
votes
1
answer
1k
views
After upgrading from PHP 8.3 to 8.4 I get "Maximum call stack size ... reached. Infinite recursion?"
After upgrading my project from PHP 8.3 to PHP 8.4, I started getting the following error:
Maximum call stack size of 8339456 bytes (zend.max_allowed_stack_size - zend.reserved_stack_size) reached. ...
3
votes
1
answer
129
views
Google Cloud Logging API "Control Requests" Quota Exceeded in Calling Project for Cross-Project Operations
Problem:
Our backend service (in Project A) interacts with resources in Project B (e.g., fetching Logging buckets). While resource-specific quotas (e.g., log ingestion) are correctly consumed by ...
0
votes
1
answer
85
views
Unable to fetch GCP Dataflow worker logs using Python google-cloud-logging despite correct filter
def check_worker_logs(event_uuid, dataflow_project, dataflow_job, timeframe_mins=30):
# Start time of the worker log
start_time = (datetime.utcnow() - timedelta(minutes=timeframe_mins))....
0
votes
0
answers
177
views
Can't get a real response from Vertex AI on Cloud Run
I'm new to Vertex AI/hosting things on Cloud Run.
I went to Prompt management, created a prompt, and clicked Build with code. Now my prompt is hosted on Google run in a Gradio app.
When I go to the ...
1
vote
1
answer
116
views
How can I create GAUGE COUNTER using log-based metrics in cloud logging?
I am logging an INT64 value (something like CPU usage) in my cloud function and I want to turn it into a metrics in cloud monitoring, it seems like I can either integrate directly with cloud ...
0
votes
1
answer
139
views
Can custom headers be added to automatically generated Cloud Logging logs in Cloud Run?
A similar question was asked nearly two years ago, but there was no confirmed answer. Is it now possible to add custom attributes to the automatically generated logs in Cloud Run?
I’m not referring to ...
1
vote
2
answers
505
views
Logging to the console can be slow [closed]
Google has some recommendations about logging in their blog page here:
Logging recommendations for containerized applications
Before we dive into some typical use cases for logging in GKE, let's ...
1
vote
1
answer
153
views
How to query Google Cloud Logging Log Analytics dataset via API in Node.js?
I have a set of services logging requests in Google Cloud Logging. Using Log Analytics (not to be confused with Logs Explorer), I can run complex queries on logs, including aggregations and GROUP BY ...
1
vote
1
answer
626
views
How to fetch real-time google cloud run job logs?
I am building a CI/CD kind of tool which is actually a web app. The stack is django-rest-framework on the backend and React (Vite) on the frontend.
Currently the pipeline running and the actions from ...
-2
votes
2
answers
162
views
Issue with Creating Pub/Sub and Log Sink in Docker Container
I am trying to create a Pub/Sub topic and a log sink in Google Cloud. The idea is to create a log sink and assign the role pubsub.publisher to the log sink's service account for the Pub/Sub topic ...
0
votes
1
answer
620
views
How to check error logs of ”FcmService.SendMessage” request on Google Cloud
When checking the Firebase Cloud Messaging API console on Google Cloud ("API/Service Details"), it shows that 22.92% of google.firebase.fcm.v1.FcmService.SendMessage requests are failing.
...
0
votes
0
answers
54
views
Log-Based GDP Alert Policy Fails to Trigger Incidents and Send Emails
I'm following this tutorial.
Alert policy is created and I write a test log entry but no incident is created and no alert e-mail is sent.
My policy settings and status are bellow;
Configurations
Logs ...
1
vote
0
answers
76
views
Violated policy does not create alert
I have a Google project where I execute and log from an Apps Script. I created a log monitoring policy to be notified if severity>=ERROR and in the preview during policy creation the filter lists ...
1
vote
1
answer
285
views
How can I get traceId in a Firebase cloud function?
I would like to propagate traceId between a couple microservices in Firebase/GCP by 1) getting the traceId from the root service, and 2) propagating it using "x-cloud-trace-context" in the ...
0
votes
2
answers
478
views
How to enable logs from GCP instances to Google logs exporter?
Sometimes our GCP VM instances reboot without any apparent reason, and I want to view the logs of the VMs using the Google Logs Exporter service. In my GCP project, I have more than 200 instances, but ...
0
votes
1
answer
206
views
Copy all log entries in one google cloud log to another log
I have a google cloud project with two logs named project/myproject/logs/A and project/myproject/logs/B. I am no longer sending any log entries to the first log. I would like to copy all the logs out ...
0
votes
1
answer
127
views
How can I elevate all SQL exceptions to FATAL log level when using Serilog.Sinks.GoogleCloudLogging?
I'm using Serilog in my .NET application along with Serilog.Sinks.GoogleCloudLogging to send logs to Datadog. I would like to automatically elevate all SQL exceptions (SqlException) to the Fatal (or ...
0
votes
1
answer
111
views
What is an approriate Monitored Resource Type in Google Cloud for logs coming from vercel?
I have set up a log drain in my Vercel app that points to an HTTP endpoint that inserts log records into Google Cloud Logging. When I do this, I must select a monitored resource for each log entry. ...
1
vote
1
answer
455
views
Query Log Analytics from Cloud Function
I want to analyse GCP logs in real time and make alerts from it. Because analysis depends on some aggregations and correlations (example: event A happend less then 10 min from the event B so there ...
1
vote
1
answer
375
views
Set up Structured logging in cloud composer
I am trying to implement a custom logging format which includes a few variables which I get from the Google Cloud Composer environment, I have followed the docs which helped me in formatting the ...
0
votes
1
answer
417
views
Python Container Logs aren't Showing up in Google Cloud's Log Explorer
I'm trying to log a simple "hello world!" inside a python file which is being built as a Cloud run job container. However, my logs are not showing up in the log explorer, although the job is ...
0
votes
1
answer
130
views
Getting syntax error for JOIN applied between two metrics
Writing first MQL query to achieve below:
reads log from a metric "logging.googleapis.com/user/count_verify_country" which has a field COUNTRY
reads log from another metric "logging....
1
vote
1
answer
290
views
No logs for the default-allow-icmp FW rule
I'm trying to catch and log the ICMP packets between 2 GCE instances. To do this I enabled logging for the default-allow-icmp rule:
Priority: 65534
Direction: Ingress
Action on match: Allow
Source ...
2
votes
1
answer
996
views
How to write a REGEXP_EXTRACT expression in Google Cloud Logging config json?
I am trying to extract the value at the end of this log:
Chat request completed in 3.818780105999849
This is a log saved in Google Cloud Logging and the message is written in the textPayload field. I ...
0
votes
0
answers
35
views
How do I find detail about failed scheduled extracts?
I am looking for all failures for scheduled extracts. They are not included in the regular LookStudio log files and according to other articles I have found, I need BigQuery Cloud Logging access to ...
0
votes
1
answer
253
views
Error while scanning intermediate done dir - dataproc spark job
Our spark aggregation jobs are taking a lot of execution time to complete. It supposed to complete in 5 mins but taking 30 to 40 minutes to complete.
dataproc cluster logging say it's trying to scan ...
0
votes
1
answer
134
views
Extract conversation history in DialogFlow request
I'm having trouble retrieving the requests and responses from a chatbot I've created in Dialogflow using the Cloud Logging REST API. The thing is, I can see the name of the log, which is ...
1
vote
0
answers
725
views
How to Stop Google Cloud Ops Agent from Logging syslog Entries?
I've been trying to configure the Google Cloud Ops Agent (formerly known as Stackdriver Logging) to stop collecting syslog entries on my Ubuntu server, but despite several attempts, it continues to ...
2
votes
1
answer
874
views
How to use logging with custom jsonPayload in GCP Dataflow
by default, GCP Dataflow 'just works' with the standard Python logging library, so:
import logging
logging.info('hello')
yields a log message in Google Logging while the Dataflow job runs in GCP. ...
0
votes
1
answer
684
views
How to get all users logged into GCP project
I am trying to build a dashboard to get all logged in users accessing GCP project. Is there a way to get the details from the log explorer and build a dashboard for monitoring and alerting. I am not ...
4
votes
0
answers
932
views
How to log custom request headers in GCP Logs Explorer?
I am sending a request to a Cloud Run which first passes through a load balancer. The issue is that there is a custom header in the request but it is nowhere to be found in the logs. I looked into the ...
1
vote
0
answers
257
views
Duplicate log entries google cloud logging, opentelemetry.sdk python
I am parsing txt files that contain the logs of GitHub Workflow Jobs/Steps and send them to google cloud. I am using below code :
import logging
import google.cloud.logging
from opentelemetry.sdk....
0
votes
1
answer
397
views
Determine Google Cloud Logs size in bytes generated from Cloud Run services
I have over 30 cloud run services and I want to know which services generates the most logs in bytes in order to reduce logging costs.
I searched in the sample library of the Monitoring > ...
0
votes
0
answers
400
views
How do I create a google_monitoring_alert_policy containing a filter checking for missing values
I'm want to create a google_monitoring_alert_policy that checks if a field is present in the LogEntry by using the :* syntax described by the docs.
But Terraform returns:
Error creating AlertPolicy: ...
1
vote
0
answers
165
views
Resource type in google cloud logs falls back to 'global' when logged from dataproc using google-cloud-logging python library
I have a python code which runs in the context of GCP DataProc. The project uses google-cloud-logging python library for logging (as far as I understand it is formerly known as 'Stackdriver' logs).
I ...
0
votes
1
answer
94
views
Trace who updated a Firestore document in a Cloud Function
I encountered a situation in which one of my Firestore docs changed unexpectedly.
I have a Firebase Cloud Function which listens to those doc updates. I have a trace id of a log from that function.
Is ...
1
vote
0
answers
105
views
How to correlate and aggregate logs in Google App Engine Python 3?
In order to get our App Engine application logs to correlate and aggregate all logs from a single request into one collapsed log entry in the Google Cloud Console Logs Explorer, seemingly we need to ...
0
votes
1
answer
689
views
Is there a way to send logs directly to google cloud logging using opentelemetry in a spring boot application?
I am trying to send the application logs directly to google cloud logging using opentelemetry.
With the below changes, the logs are sent to OpenTelemetry collector which is up on port 4318
pom.xml
<...
0
votes
2
answers
332
views
Is it possible to use SMS notification channel for GCP error reporting?
I created a SMS notification that works with log based metrics. But I can not find a way to use it for notifications for Error reporting. It does not show when I open the dropdown me nu to select the ...
0
votes
1
answer
172
views
App engine standard and automatic error logging question (and also regarding Error reporting)
I am doing my first App engine project using App engine standard and Nodejs. I like the experience but I am having issues right now with error logging.
It seems that App engine logs every application ...
0
votes
0
answers
97
views
Access Control for Google Cloud Logging
I am trying to maintain access control for google cloud logging.
For example, I have a compute engine VM, inside which multiple applications are running inside an OpenShift cluster e.g. application 1, ...
0
votes
1
answer
158
views
How to trigger a Google Cloud Function when a scheduled compute engine "disk snapshot" is created
When a "disk snapshot" is created in Google Cloud - I scheduled the "disk snapshots" with the Google Cloud dashboard - I need to turn it into an "Image", and then export ...
0
votes
1
answer
71
views
Firebase onCreate Cloud Function not working
i'm using react and firebase. I have a simple cloud function that is not performing. I'm adding reviews to my site and i want cloud functions to add tracking information about the reviews like the ...
0
votes
1
answer
97
views
How to fix Firebase cloud function logs table too many columns
I have a firebase project where I have a number of functions logging data.
Every now again again I see this error:
Too many total leaf fields: 10002, max allowed field count: 10000
What I believe has ...
1
vote
2
answers
1k
views
How to set the Severity as Error in GCP alert page using Terraform GCP
I am setting up for IaC in Terraform for Google cloud function when error occurs.
This is my code in Terraform:
resource "google_monitoring_alert_policy" "my_cf_alert_policy" {
...
0
votes
1
answer
318
views
Airflow / Cloud Composer log entry to indicate if a DAG was disabled or enabled
We had an issue with our Cloud Composer / Airflow environment last week and we're trying to work out whether or not a given DAG was enabled or not at the time of the issue.
However, diving into the ...
6
votes
1
answer
459
views
How to make Google Stackdriver works with Rails 7.1+
I just spent a few hours looking over the internet to find out how to resolve that issue. But, for the life of me, I have no idea what to do...
I followed the documentation provided by Google github....