Skip to main content
3,143 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
0 votes
1 answer
75 views

I have Pub/Sub subscription to a Pub/Sub topic that uses BINARY encoding and a PROTOCOL_BUFFER topic schema. The messages published there are encoded as protocol buffers (protobuf) I wanted to write a ...
RubenLaguna's user avatar
  • 25.7k
0 votes
0 answers
93 views

I am trying to figure out if there is a way to send a JSON object to a BigQuery table that has a column of type JSON. I know the current practice is to stringify the JSON and send it over which gets ...
Antares's user avatar
  • 100
0 votes
1 answer
105 views

I have a BigQuery push subscription in Pub/Sub that for some reason changes the values of the fields with float datatype when pushed to BigQuery. I tried creating a pull subscription and attached it ...
mads.koop's user avatar
  • 3
0 votes
0 answers
64 views

I’m working on a project that uses Flask as the publisher and a Python subscriber to handle messages with Google Cloud Pub/Sub. My setup: A local Flask front end publishes messages (itemID, location, ...
niya's user avatar
  • 1
0 votes
0 answers
102 views

I have an integration test that publishes a domain event to Google Cloud Pub/Sub (using the Pub/Sub emulator). Eventduspatcher.integration.test.ts passes but Jest prints: Jest did not exit one second ...
gonchan's user avatar
  • 1
0 votes
1 answer
95 views

Problem I'm using Google Cloud PubSub with synchronous pull and ordering enabled to consume messages from a Debezium Server setup, but I'm only receiving one message at a time instead of getting ...
pramod's user avatar
  • 193
0 votes
0 answers
64 views

I am using Spark 3.5.x and would like to use readStream() API to read structured streaming using Java . I don't see any pubsub connector available. Couldn't try pubsub lite because it is deprecated ...
Sunil's user avatar
  • 441
0 votes
1 answer
204 views

Currently I am working on a project that publishes any received request contents to a pub sub topic and subsequent subscriber, in order to pull and batch process all of the messages at once every ...
William Wood's user avatar
  • 3
0 votes
0 answers
100 views

I have a .NET 8 background worker running on Cloud Run. The worker should publish messages to Pub/Sub, but I always get the following error at runtime: System.InvalidOperationException: Your default ...
nokecmec's user avatar
  • 26
0 votes
1 answer
95 views

With all nodejs packages updated, trying to publish message to topic ends on timeout with error: GoogleError: Total timeout of API google.pubsub.v1.Publisher exceeded. Error: Getting metadata from ...
Dast's user avatar
  • 24
1 vote
0 answers
178 views

I have a Go application, where I create a Pub/Sub client and then I create a subscriber receiving from a topic/subscription I've created locally using a local Docker gcloud emulator container. ...
bhk's user avatar
  • 1,063
4 votes
3 answers
591 views

We use protocol buffers both for gRPC server-to-server communication and for publishing messages to Pub/Sub. Pub/Sub is fairly sensitive to schema changes, not allowing any schema changes that would ...
Mike Williamson's user avatar
  • 4,140
1 vote
1 answer
72 views

I ran this standard query and it executes successfully. EXPORT DATA OPTIONS ( uri = 'https://pubsub.googleapis.com/projects/ggdevbigqueryproject/topics/GGTEST', format = 'JSON', ...
dhrubajyoti chatterjee's user avatar
  • 11
0 votes
0 answers
89 views

Does anyone know the best doc to follow for pulling data from a Google Form via Apps Script and sending that data to pubsub, been following this guide https://developers.google.com/workspace/forms/api/...
Mizanur Choudhury's user avatar
  • 346
0 votes
1 answer
138 views

Currently we are using a third party library CredClient to get the credentials which has methods to get credentials and to refresh credentials. We are using Spring auto configuration and manually ...
krishna thota's user avatar
  • 307
2 votes
2 answers
201 views

I am running several GCP subscribers that are connected to a GCP subscription and I have tried everything but the subscribers just do not keep up with the incoming data. My most recent configuration ...
tall_tales's user avatar
  • 33
0 votes
1 answer
165 views

I'm facing a problem with message ordering on pubsub: I see that 2 events were processed on the same time although the ordering key is the same. I mean: Event A received and started to be handled. ...
Shay Schwarztuch's user avatar
  • 1
0 votes
0 answers
63 views

I have a Spring Boot Camel project that consumes messages from GCP PubSub subscription and updates 4 AWS DYnamoDB tables. The subscription has the following parameters: acknowledgement deadline (...
Shankar's user avatar
  • 2,895
0 votes
1 answer
55 views

We have set up a ConsumeGCPubSub processor in Nifi so that we get informed if files are added or deleted on our GCS bucket. This is working, however, in the messages that the processor is emitting, ...
misja111's user avatar
  • 343
2 votes
0 answers
120 views

My objective is to develop Python scripts that read the current messages in the client's Gmail inbox, and read the live messages coming through the client's Gmail inbox. This data will eventually by ...
bradenlearnscode's user avatar
  • 21
1 vote
0 answers
157 views

I have a pull subscription to a pubsub topic. example of message I'm sending: { "event_id": "200595", "user_id": "15410", "session_id": &...
Stephen's user avatar
  • 333
0 votes
1 answer
252 views

I have a Cloud Function (v1) that is set to trigger every time a message is received in a specific topic. This part of the configuration is done correctly (since I've followed previous working cloud ...
marianod323's user avatar
  • 39
1 vote
0 answers
128 views

I am trying to figure out the source of latency in my application as I am seeing a number of un-acked messages per unit time on the dashboard for my GCP Pub/Sub subscription. My application simply ...
tall_tales's user avatar
  • 33
0 votes
0 answers
88 views

I have a Node app that is running on railway.com in a Docker container. This app uses GCP pub/sub. One oddity of railway.com is I can't find a way to inject a file as a secret or a file into a ...
joshk132's user avatar
  • 1,123
0 votes
1 answer
183 views

I have a GCP Pub/Sub Streaming Pull subscriber that has an Ack rate equal to the Pull rate. I am seeing a lot of latency on my end and I decided to investigate further. I find that the Publish to Ack ...
tall_tales's user avatar
  • 33
0 votes
1 answer
467 views

I have a GCP subscriber that uses Streaming Pull API to pull messages from a GCP subscription. There is only one GCP subscription and one subscriber attached to this subscription. I am seeing delay of ...
tall_tales's user avatar
  • 33
0 votes
0 answers
105 views

I was trying to create an alert for messages not getting published to pubsub topic. Usecase: if message are not getting published for 10mins trigger an alert Problem: Although the job producing ...
Mr. Techie's user avatar
  • 916
0 votes
1 answer
115 views

I am testing my Pub/Sub setup with dead lettering enabled. Inside my subscriber application, I have not added any ack logic so all messages will not be acked by my subscriber. I set the maximum ...
Manxue Li's user avatar
  • 1
0 votes
0 answers
75 views

My beam python on flinkrunner(PortableRunner) has the following code. from apache_beam.io.external.gcp.pubsub import ReadFromPubSub from dependency_injector import providers ... pubsub_reader = ...
Dogil's user avatar
  • 117
0 votes
0 answers
62 views

@pubsub_bp.route("/api/pubsub/events", methods=["POST"]) def handle_pubsub_event(): try: print("Received Pub/Sub event") envelope = request.get_json() ...
Dilip Tarkhala's user avatar
  • 23
0 votes
0 answers
163 views

Problem We use Cloud Run to process upload events, where a user can upload hundreds of images at once. This causes high usage spikes, and since we are limited to 25 Cloud Run instances, many Pub/Sub ...
Michiel's user avatar
  • 1,863
0 votes
1 answer
525 views

I'm running into an issue when trying to use the Google Cloud Pub/Sub Emulator. I am able to start the emulator successfully, but I cannot create topics or interact with it using gcloud commands. I ...
Rosscoasks's user avatar
  • 109
0 votes
1 answer
537 views

I have a API on CloudRun which publishes a payload to a Pubsub topic which triggers a Cloudfunction. When I test it, the publishMessage() call takes more than 200ms to complete. This is my code to ...
Asif Alam's user avatar
  • 53
1 vote
0 answers
111 views

I am using the GCP Pub/Sub to get real-time google logs into my Python application. I have created a log Sink that routes specific cloud run job logs into a Pub/Sub topic and I am subscribing to that ...
4bs3nt's user avatar
  • 90
-1 votes
1 answer
64 views

How does Benthos handle the acknowledgement of pubsub messages? How can we manage ack/unack based on custom if-else conditions? Here is the scenario i'm trying to achieve: I have written a Benthos job ...
Tarun Kumar's user avatar
  • 1
0 votes
1 answer
180 views

Hi this is mainly a Question on how Pub/Sub can invoke a service on google run while not having an identical subscription endpoint to the service. Going to post the image of a url of a Google Run URL ...
Jualston's user avatar
  • 39
-2 votes
2 answers
162 views

I am trying to create a Pub/Sub topic and a log sink in Google Cloud. The idea is to create a log sink and assign the role pubsub.publisher to the log sink's service account for the Pub/Sub topic ...
kernal42's user avatar
  • 153
0 votes
2 answers
182 views

I am trying to understand the difference between the ackDeadline property on the Subscription and the ackDeadline property on the Subscriber. It is clear that the ackDeadline on the Subscription is ...
tall_tales's user avatar
  • 33
0 votes
2 answers
119 views

Docs say: The oldest_unacked_message_age ... measures the age, in seconds, of the oldest message in a subscription's backlog that has not yet been acknowledged (acked) by a subscriber. In order to ...
lf215's user avatar
  • 1,221
-1 votes
1 answer
419 views

I want to use pubsub in an application that uses asyncio as a basic way of achieving I/O concurrency. The default Google SDK, however doesn't offer async methods (I have tried gcloud-aio-pubsub, but ...
zefciu's user avatar
  • 2,076
2 votes
1 answer
232 views

I am working with Google Cloud Pub/Sub, and I am trying to ensure that messages with the same orderingKey are processed in order, as stated in the official documentation. However, I notice that ...
rafik's user avatar
  • 67
1 vote
1 answer
141 views

I have a topic, and subscriptions related to it with pub/sub. I'd like to test my function locally through VSCode, especially the function that triggers when a message is posted on my topic. export ...
Marie Dufau's user avatar
  • 11
0 votes
0 answers
57 views

We are using google cloud pub/sub with Python pubsub_v1.PublisherClient. We have also enabled key ordering on both the subscription and the Python publisher. After the enablement of the key ordering, ...
bioniclebeastmaster's user avatar
  • 3
0 votes
1 answer
185 views

I have subscribed to a Google pub/sub topic from my spring boot application with subscription.What happens if my service is down and There is some data which is pushed to pub/sub topic. Will i receive ...
qwerty's user avatar
  • 23
1 vote
0 answers
60 views

I'm using Google Cloud Pub/Sub with exactly-once delivery enabled. Is there a way to stop processing a message that was pulled if the ModifyAckDeadline call fails? My concern is that if ...
KeyB0rys's user avatar
  • 524
1 vote
1 answer
94 views

during a high-load period with ~9000 messages created within 10 minutes, we observed an issue with message processing. Some pods (usually one or two) consistently returned the following error for ...
KeyB0rys's user avatar
  • 524
0 votes
0 answers
63 views

I made a firebase function and defined a pub/sub trigger: google_play_purchase_handler.py: @pubsub_fn.on_message_published(topic=GOOGLE_PLAY_PUBSUB_TOPIC, region=REGION) async def ...
Orl13's user avatar
  • 604
0 votes
0 answers
43 views

I am watching a gmail using gmail API and I have integrated pub/sub to allow push notification whenever there is an change in the gmail INBOX. while configuring pub/sub, I have given API gateway URL(...
siddharth's user avatar
  • 1
0 votes
1 answer
151 views

We have a GCP pub sub subscription with the Expiration set to 1 day, while the Message Retention Duration is also set to 1 day. There were no messages in the subscription but it still did not expire ...
RaRa's user avatar
  • 306
1 vote
1 answer
87 views

I have a subscription in Google Pub/Sub where messages can be either acknowledged (acked) or not acknowledged (nacked). To handle the at-least-once delivery guarantee of Pub/Sub, I use an idempotent ...
Nikita Alkhovik's user avatar
  • 43

1
2 3 4 5
…
63