Hi Team, I did follow the doc for upgrading CN 1.7...
# gooddata-cn
h
Hi Team, I did follow the doc for upgrading CN 1.7 to 2.2 on helm Kubernetes, The installation was successful but got lots of errors: Please help
Copy code
{"ts":"2023-01-04 21:55:39.973","level":"WARN","logger":"org.apache.pulsar.client.admin.internal.BaseResource","thread":"AsyncHttpClient-11-1","msg":"[<http://pulsar-broker.pulsar:8080/admin/v2/persistent/gooddata-cn/gooddata-cn/result.xtab>] Failed to perform http put request: org.apache.pulsar.shade.javax.ws.rs.ClientErrorException: HTTP 409 Conflict"}
{"ts":"2023-01-04 21:55:40.151","level":"ERROR","logger":"org.springframework.boot.SpringApplication","thread":"main","msg":"Application run failed","exc":"org.apache.pulsar.client.admin.PulsarAdminException$NotAllowedException: Topic level policies is disabled, to enable the topic level policy and retry.\n\tat org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:232)\n\tat org.apache.pulsar.client.admin.internal.TopicPoliciesImpl.setMessageTTL(TopicPoliciesImpl.java:674)\n\tat com.gooddata.tiger.pulsar.PulsarAutoConfiguration.producerBeanFactory$lambda-1(PulsarAutoConfiguration.kt:135)\n\tat org.springframework.context.support.PostProcessorRegistrationDelegate.invokeBeanFactoryPostProcessors(PostProcessorRegistrationDelegate.java:325)\n\tat org.springframework.context.support.PostProcessorRegistrationDelegate.invokeBeanFactoryPostProcessors(PostProcessorRegistrationDelegate.java:198)\n\tat org.springframework.context.support.AbstractApplicationContext.invokeBeanFactoryPostProcessors(AbstractApplicationContext.java:746)\n\tat org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:564)\n\tat org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:145)\n\tat org.springframework.boot.SpringApplication.refresh(SpringApplication.java:745)\n\tat org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:420)\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:307)\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:1317)\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:1306)\n\tat com.gooddata.tiger.cache.result.ResultCacheApplicationKt.main(ResultCacheApplication.kt:41)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)\n\tat java.base/java.lang.reflect.Method.invoke(Unknown Source)\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49)\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:108)\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:58)\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:88)\nCaused by: org.apache.pulsar.shade.javax.ws.rs.NotAllowedException: HTTP 405 Method Not Allowed\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:951)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation.translate(JerseyInvocation.java:755)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$1(JerseyInvocation.java:675)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation.call(JerseyInvocation.java:697)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation.lambda$runInScope$3(JerseyInvocation.java:691)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.internal.Errors.process(Errors.java:292)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.internal.Errors.process(Errors.java:274)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.internal.Errors.process(Errors.java:205)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:390)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation.runInScope(JerseyInvocation.java:691)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:674)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:450)\n\tat org.apache.pulsar.shade.org.glassfish.jersey.client.JerseyInvocation$<http://Builder.post|Builder.post>(JerseyInvocation.java:351)\n\tat org.apache.pulsar.client.admin.internal.TopicPoliciesImpl.setMessageTTL(TopicPoliciesImpl.java:672)\n\t... 20 more\n"}
{"ts":"2023-01-04 21:55:40.200","level":"INFO","logger":"org.apache.pulsar.client.impl.PulsarClientImpl","thread":"main","msg":"Client closing. URL: <pulsar://pulsar-broker.pulsar:6650>"}
###################### 2023-01-04T215009,160+0000 [QuorumPeer[myid=3](plain=0.0.0.0:2181)(secure=disabled)] INFO org.apache.zookeeper.server.quorum.FastLeaderElection - Notification time out: 12800 2023-01-04T215009,180+0000 [QuorumConnectionThread-[myid=3]-3] WARN org.apache.zookeeper.server.quorum.QuorumCnxManager - Cannot open channel to 2 at election address pulsar-zookeeper-1.pulsar-zookeeper.pulsar.svc.cluster.local:3888 java.net.UnknownHostException: pulsar-zookeeper-1.pulsar-zookeeper.pulsar.svc.cluster.local at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:229) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?] at java.net.Socket.connect(Socket.java:609) ~[?:?] at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:383) [org.apache.zookeeper-zookeeper-3.6.3.jar:3.6.3] at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:457) [org.apache.zookeeper-zookeeper-3.6.3.jar:3.6.3] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] at java.lang.Thread.run(Thread.java:829) [?:?]
@Robert Moucha I used your YAML for pulsar on another thread, It looks like fixing the issue. components: functions: false proxy: false pulsar_manager: false toolset: false monitoring: alert_manager: false grafana: false node_exporter: false prometheus: false images: autorecovery: repository: apachepulsar/pulsar bookie: repository: apachepulsar/pulsar broker: repository: apachepulsar/pulsar zookeeper: repository: apachepulsar/pulsar zookeeper: volumes: data: name: data size: 2Gi storageClassName: standard-rwo replicaCount: 3 resources: limits: cpu: 500m memory: 512Mi bookkeeper: configData: PULSAR_MEM: > -Xms128m -Xmx256m -XX:MaxDirectMemorySize=128m metadata: image: repository: apachepulsar/pulsar replicaCount: 3 resources: requests: cpu: 0.2 memory: 128Mi volumes: journal: name: journal size: 5Gi storageClassName: standard-rwo ledgers: name: ledgers size: 5Gi storageClassName: standard-rwo pulsar_metadata: image: repository: apachepulsar/pulsar broker: # this setting is recommended to automatically apply changes in the configuration to the broker # uncomment the following line to turn it on # restartPodsOnConfigMapChange: true configData: PULSAR_MEM: > -Xms128m -Xmx256m -XX:MaxDirectMemorySize=128m subscriptionExpirationTimeMinutes: "5" webSocketServiceEnabled: "true" systemTopicEnabled: "true" topicLevelPoliciesEnabled: "true" replicaCount: 3 resources: requests: cpu: 0.2 memory: 256Mi
i
Hi Hamid, I am sorry to hear about your initial troubles. Does everything work as expected now, please?
h
Hi @Ivana Gasparekova The Pulsar Yaml, fix the issue. Thanks for checking
🙌 1
r
yes, you need to set
systemTopicEnabled
and
topicLevelPoliciesEnabled
as mentioned in Upgrade Guide section of release notes
🙌 2