Skip to content

502 Bad Gateway Pub/Sub 0.9.0-alpha #1616

Closed
Closed
502 Bad Gateway Pub/Sub 0.9.0-alpha#1616
Assignees
garrettjonesgoogle
Labels
api: pubsubIssues related to the Pub/Sub API.

Description

@GEverding
GEverding
opened on Feb 13, 2017

Hey, Trying out the new pubsub client and I'm getting 502 Bad Gateway.

17:51:44.832 |- INFO  c.wemesh.clerk.GooglePubSubConsumer$ - Waiting for messages from subscription: x.events.gray
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.Subscriber$SubscriberImpl doStart
INFO: Starting subscriber group.
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@1442f788] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@42373389] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@9b21bd3] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@a62c7cd] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@7661b5a] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@7c36db44] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@65c33b92] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@7903d448] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@4e08acf9] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM io.grpc.internal.ManagedChannelImpl <init>
INFO: [ManagedChannelImpl@42ea287] Created with target pubsub.googleapis.com:443
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection doStart
INFO: Starting subscriber.
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
Feb 13, 2017 5:51:46 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection initialize
INFO: Initializing stream to subscription projects/wemesh-inc/subscriptions/x.events.gray with deadline 10
17:51:46.536 |- INFO  com.wemesh.clerk.RpcServer - Server started, listening on 10006
Feb 13, 2017 5:51:47 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection$StreamingPullResponseObserver onError
INFO: Terminated streaming with exception
io.grpc.StatusRuntimeException: UNAVAILABLE: 502:Bad Gateway
	at io.grpc.Status.asRuntimeException(Status.java:545)
	at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:481)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:398)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:513)
	at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
	at io.grpc.internal.SerializingExecutor$TaskRunner.run(SerializingExecutor.java:154)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

Feb 13, 2017 5:51:47 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection$StreamingPullResponseObserver onError
INFO: Terminated streaming with exception
io.grpc.StatusRuntimeException: UNAVAILABLE: 502:Bad Gateway
	at io.grpc.Status.asRuntimeException(Status.java:545)
	at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:481)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:398)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:513)
	at io.grpc.internal.ContextRunnable.run(ContextRun

Activity

  1. garrettjonesgoogle commented on Feb 13, 2017

    @garrettjonesgoogle
    garrettjonesgoogle
    on Feb 13, 2017
    Contributor

    Subscriber is designed to fall back to polling if the streaming doesn't work. Notice that all of the logs are at INFO level. Is the polling logic working?

  2. GEverding commented on Feb 13, 2017

    @GEverding
    GEverding
    on Feb 13, 2017
    Author

    It doesn't fall back properly. When the status code is UNAVAILABLE (src) it still considers the connection retryable and doesn't call notifyFailure (src) and then the failure handler in subscriber doesn't switch to polling (src)

  3. matthewrj commented on Feb 14, 2017

    @matthewrj
    matthewrj
    on Feb 14, 2017

    I'm experiencing the same issue. My logs are continuous streams of "UNAVAILABLE: 502:Bad Gateway" and messages aren't being processed.

  4. GEverding commented on Feb 14, 2017

    @GEverding
    GEverding
    on Feb 14, 2017
    Author

    Is there any workaround for this issue? I tried packaging up a custom version of the library but ran into issues with maven?

  5. garrettjonesgoogle commented on Feb 14, 2017

    @garrettjonesgoogle
    garrettjonesgoogle
    on Feb 14, 2017
    Contributor

    We will get a fix out soon.

  6. garrettjonesgoogle commented on Feb 15, 2017

    @garrettjonesgoogle
    garrettjonesgoogle
    on Feb 15, 2017
    Contributor

    This should be fixed by #1625 ; we'll try to get a release out soon.

  7. garrettjonesgoogle
    added
    blocking beta
    api: pubsubIssues related to the Pub/Sub API.
    on Feb 18, 2017

  8. pongad commented on Feb 18, 2017

    @pongad
    pongad
    on Feb 18, 2017
    Contributor

    @garrettjonesgoogle The mentioned fix went out with 0.9.1. I think we can close this out?

  9. prestonvanloon commented on Feb 19, 2017

    @prestonvanloon
    prestonvanloon
    on Feb 19, 2017

    I am getting the same message in 0.9.2.

    Feb 18, 2017 8:30:18 PM com.google.cloud.pubsub.spi.v1.StreamingSubscriberConnection$StreamingPullResponseObserver onError
INFO: Terminated streaming with exception
io.grpc.StatusRuntimeException: UNAVAILABLE: 502:Bad Gateway
	at io.grpc.Status.asRuntimeException(Status.java:545)
	at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:481)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:398)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:513)
	at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
	at io.grpc.internal.SerializingExecutor$TaskRunner.run(SerializingExecutor.java:154)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

    By 0.9.2, I mean the jar on maven tagged as 0.9.2-alpha

  10. masangin commented on Feb 19, 2017

    @masangin
    masangin
    on Feb 19, 2017

    I'm experiencing the same issue on 0.9.2-alpha.

  11. pongad commented on Feb 20, 2017

    @pongad
    pongad
    on Feb 20, 2017
    Contributor

    I must have looked at the history wrong somehow.
    The fix for this landed in commit 68ce84d313b7745b1dc37be300522ea1c051063b, 3 commits after the last release. This should be fixed in the next release.
    I apologize for the confusion.

  12. GEverding commented on Feb 21, 2017

    @GEverding
    GEverding
    on Feb 21, 2017
    Author

    when can we reasonably expect this in a new release? The library is broken right now.

  13. garrettjonesgoogle commented on Feb 22, 2017

    @garrettjonesgoogle
    garrettjonesgoogle
    on Feb 22, 2017
    Contributor

    The fix has been released in 0.9.3-alpha. Now closing this issue.

  14. garrettjonesgoogle
    closed this as completedon Feb 22, 2017

  15. prestonvanloon commented on Feb 23, 2017

    @prestonvanloon
    prestonvanloon
    on Feb 23, 2017

    Thanks @garrettjonesgoogle. 0.9.3-alpha is working well so far.

  16. JustinBeckwith
    assigned
    garrettjonesgoogle
    on Feb 1, 2021
  17. chingor13
    added a commit that references this issue on Feb 24, 2026

    chore(ci): set up release-please (#1616)

    2f2c269
  18. chingor13
    added a commit that references this issue on Mar 12, 2026

    chore(ci): set up release-please (#1616)

    41aa4c2
  19. suztomo
    added a commit that references this issue on Mar 23, 2026

    deps: update dependency org.springframework.boot:spring-boot-starter-…

    0e3f153
  20. suztomo
    added a commit that references this issue on Mar 30, 2026

    deps: update dependency com.google.apis:google-api-services-storage t…

    153a379
  21. lqiu96
    added a commit that references this issue on Apr 1, 2026

    deps: update dependency com.google.apis:google-api-services-storage t…

    6cabd50
  22. meltsufin
    added 4 commits that reference this issue on Apr 29, 2026

    deps: update dependency org.xerial.snappy:snappy-java to v1.1.10.1 - …

    48ec282

    chore(main): release 1.133.0 (#2206)

    a3b6539

    deps: update dependency org.xerial.snappy:snappy-java to v1.1.10.1 - …

    0901a4d

    chore(main): release 1.133.0 (#2206)

    1180af9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

api: pubsubIssues related to the Pub/Sub API.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions