To GoodData homepage

Replies posted by NickK

22 Replies

N
NickKKnown Participant
asked in Administration

Docker-compose setup for GoodData.CN

I have to return to this topic.We’re providing SaaS for most of our clients. But some clients require on-premise installations. We currently have that as a single server like 4 CPUs and 16Gb RAM. I don’t think it’s appropriate to ask the client to deploy K8s with 3 nodes just for analytics/dashboards. Is there a chance we could have just 1 more server or better just upgrade existing server to add more CPUs and RAM and just have a simple docker-compose installation running?

4
M
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

GoodData created 21k threads!

Ok, thanks.

9
J
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

GoodData created 21k threads!

Ok, I’ve killed the process and number of threads became around 1k total.But it doesn’t look to solve the issue: I can see that the new process still adds 1-2 threads per second, so it will eventually get to the same point:  

9
J
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

GoodData created 21k threads!

Here it is.

9
J
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

GoodData created 21k threads!

Here it is: $ ps aux |grep javanfsnobo+ 9637 6.0 6.0 34731572 1969836 ? Ssl июл08 58:05 java -Xmx4g -Xms128m -XX:+UseStringDeduplication -XX:+ExplicitGCInvokesConcurrent -XX:+ParallelRefProcEnabled -Xlog:gc*:file=/tmp/aio/afm-exec-api-gc.log:time,level,tags -Dlogging.level.root=WARN -Djava.security.egd=file:/dev/./urandom -cp /opt/afm-exec-api org.springframework.boot.loader.JarLauncherroot 9643 5.2 2.3 6875976 762920 ? Ssl июл08 49:40 /opt/java/openjdk/bin/java -cp /opt/apache-pulsar-2.6.1/conf:::/opt/apache-pulsar-2.6.1/lib/*: -Dlog4j.configurationFile=log4j2.yaml -Djute.maxbuffer=10485760 -Djava.net.preferIPv4Stack=true -Dpulsar.allocator.exit_on_oom=true -Dio.netty.recycler.maxCapacity.default=1000 -Dio.netty.recycler.linkCapacity=1024 -Xms128m -Xmx128m -XX:MaxDirectMemorySize=256m -XX:+UseG1GC -XX:MaxGCPauseMillis=10 -XX:+ParallelRefProcEnabled -XX:+UnlockExperimentalVMOptions -XX:+DoEscapeAnalysis -XX:ParallelGCThreads=32 -XX:ConcGCThreads=32 -XX:G1NewSizePe

9
J
GoodData Employee
2 years ago
N
NickKKnown Participant
posted in Dashboards and Reports

GoodData.CN Internal Server Error

@NickKMay I ask you to still check postgres database if this kind of issue ever happens again? Especially contents of “pg_stat_activity” table. Thanks Sure, will check that if it happens again.

24
Martin Burian
Community Manager
1 year ago
N
NickKKnown Participant
posted in Dashboards and Reports

GoodData.CN Internal Server Error

Hi @Jan Chochol,We’ve checked nginx logs and it seems like the problem was caused by a lot of HTTP POST requests like /api/actions/workspaces/…/execution/afm/executeThe response from GoodData was HTTP 500, and it seems like UI retransmitted those requests every 5 seconds. Seems like there were 2 such sessions, which is why there were 2 stuck postgres processes. They were always busy with processing such requests.We were able to clear this issue by exporting all workspaces to JSON and then importing just one that we needed at the moment.We also tuned PostgreSQL memory and upgraded EC2 instance.

24
Martin Burian
Community Manager
1 year ago
N
NickKKnown Participant
posted in Dashboards and Reports

GoodData.CN Internal Server Error

We also encounter sudden HTTP 500 from time to time.While investigating, we’ve noticed that there are 2 postgres processes inside GD.CN docker container each eats 100% of 1 CPU core:Here is postgres activity graph: We’ve also noticed that postgres is configured with default minimum memory settings:/etc/postgresql/11/main/conf.d/cloudnative-pg.conf: listen_addresses = '*'data_directory = '/data/postgresql/' # use data in another directoryshared_buffers = 128MB # min 128kB#temp_buffers = 8MB # min 800kB#work_mem = 4MB # min 64kB#maintenance_work_mem = 64MB # min 1MBWould be nice to have instructions on how to tune those. We did it like this: listen_addresses = '*'data_directory = '/data/postgresql/' # use data in another directoryshared_buffers = 12GB # min 128kBtemp_buffers = 80MB # min 800kBwork_mem = 40MB # min 64kBmaintenance_work_mem = 640MB

24
Martin Burian
Community Manager
1 year ago
N
NickKKnown Participant
asked in Administration

Can I use my own domain name with GoodData.CN (evaluation)

Sorry, I don’t get it :-(Are you saying each developer must work separately with his own data model?… or…?

14
R
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

Can I use my own domain name with GoodData.CN (evaluation)

To clear things up, how can I change domain name for default organization? Any API call for that?

14
R
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

Performance and setup of docker GoodData.CN container

Thank you, Robert! Will try tuning using JAVA_OPTS then!

4
N
2 years ago
N
NickKKnown Participant
asked in Administration

Performance and setup of docker GoodData.CN container

Hi Moises, thank you for quick reply!I was using “gooddata/gooddata-cn-ce:latest” when I first installed, how can I check which version I am using now?Here is the “docker image inspect” output:$ docker image inspect ab80ada823da[ { "Id": "sha256:ab80ada823dac729495e00f7501e3cf35fc6d5999a7a2a3c1879f71862d3fcbe", "RepoTags": [ "gooddata/gooddata-cn-ce:latest" ], "RepoDigests": [ "gooddata/gooddata-cn-ce@sha256:9fa331ad26b6e29d1d058f94bacf4d00375b8ec502cdf901bdde79c7d17a7b13" ], "Parent": "", "Comment": "", "Created": "2021-04-20T13:04:44.718975377Z", "Container": "89cabef0b8ca632fee36e4501b261f2c3a2491d0767c93e53c2a756c922e6a7f", "ContainerConfig": { "Hostname": "89cabef0b8ca", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "ExposedPorts": { "3000/tcp":

4
N
2 years ago
N
NickKKnown Participant
asked in Administration

Can I use my own domain name with GoodData.CN (evaluation)

Hi, Robert! Well now it does make sense finally! :-)I think the error text should be a bit more clear like “No Organization/tenant found for hostname XXXX”, so that when you get it, you could have an idea where to look further.Thank you!

14
R
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

Can I use my own domain name with GoodData.CN (evaluation)

Ok, that’s exactly what I had in mind. I was just confused by “Host is not registered” error when I tried to deploy GD.CN in the public cloud. Now as I understood this was not an intentional obstacle but rather a bug and GD.CN CE can be used for such deployments. Thank you.

14
R
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

Can I use my own domain name with GoodData.CN (evaluation)

Thank you, Robert!I just wonder if you’re going to add more deployment options here.It seems like you currently have only two:Install on a laptop (localhost) and for personal evaluation use only. Deploy to K8s for production.What about development teams, how are they supposed to work together teamwisely?

14
R
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

Docker-compose setup for GoodData.CN

Okay, I guess if someone wants to use a single-tenant setup, he would have to dive into your architecture and write docker-compose file by himself :)Not that I don’t need your K8s multi-tenant solution with out-of-the-box scaling, but it would be nice to have other options.

4
M
GoodData Employee
2 years ago
K
Keith FinnNew Participant
asked in Administration

Can I use my own hostname for GoodData?

@Petr Olmer - yeah, but “Hostname is not registered” error message is generated by GoodData.CN so I guess you do check for it for some reason :)

7
N
3 years ago
N
NickKKnown Participant
asked in Administration

Can I use my own domain name with GoodData.CN (evaluation)

Ah, nevermind. I figured out how to fix this with nginx:# Add some buffers because GoodData sends a lot of data in HTTP headersproxy_buffer_size 128k;proxy_buffers 4 256k;proxy_busy_buffers_size 256k;# Redirect HTTP to HTTPSserver { listen 80; server_name gooddata-dev.example.com; #Rewrite all nonssl requests to ssl. return 301 https://$host$request_uri;}server { listen 443 ssl; server_name gooddata-dev.example.com; # Path to SSL certificate and private key ssl_certificate /etc/ssl/example.crt; ssl_certificate_key /etc/ssl/example.key; location / { proxy_pass http://localhost:3000; proxy_read_timeout 90; # Replace HTTP Location URI with our domain proxy_redirect http://localhost:3000/ https://gooddata-dev.example.com/; proxy_http_version 1.1; }}I wonder why do you even check for hostname? You obviously cannot use this as any matter of restriction.If you want to restrict evaluation usage, I’d suggest to just

14
R
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Administration

Can I use my own domain name with GoodData.CN (evaluation)

Hi Jan,So you only provide evaluation for personal use and not for teams, correct?Regards, Nick.

14
R
GoodData Employee
2 years ago
K
Keith FinnNew Participant
asked in Administration

Can I use my own hostname for GoodData?

Hi Peter! Could you please clarify why do you think it doesn’t make sense?

7
N
3 years ago
K
Keith FinnNew Participant
asked in Administration

Can I use my own hostname for GoodData?

I’ve installed nginx in front of the GoodData.CN docker container.When I try to navigate by domain name I get the following error:{"title":"Not Found","status":404,"detail":"404 NOT_FOUND \"Hostname is not registered\"; nested exception is errorType=com.gooddata.tiger.grpc.error.GrpcPropagatedClientException, message=No organization found for hostname gooddata-dev.example.com,<no detail>","traceId":"911bacdd37104e6d"}

7
N
3 years ago
K
Keith FinnNew Participant
asked in Administration

Can I use my own hostname for GoodData?

Hi there! The link above seems to be broken.However seems like white-labeling the domain is not free, which seems very strange and confusing for teams (like ours) wanting to play with the product and see if it fits.All I want to do is to deploy GoodData in a docker container on our development cloud environment to let all team members test it, learn and see if it fits our needs.Without the test domain, each team member would have to use SSH tunnel to connect, which is very difficult for managers and non-IT staff.Why can’t we just set some ENV variable to our desired hostname? We don’t need any white-labeling or branding, this is just a matter of shared access to on-premise/cloud installation.Best regards, Nick.

7
N
3 years ago
Welcome to the GoodData Community!Cookie settings