To GoodData homepage

Replies posted by jacek

26 Replies

scott.jacobsen
scott.jacobsenParticipating Frequently
asked in Data sources

Are materialized views supported on the cloud native platform?

Today I merged the corresponding merge request.It should be released into GD.cloud very soon, most likely in 2023-02-23 or in 2023-03-09 at latest.

4
jacek
GoodData Employee
1 year ago
A
Aaron DsouzaNew Participant
asked in SDKs and APIs

Application created using Accelerator Toolkit keeps refreshing

Unfortunately, it is not possible to set up CORS in the community edition yet and this is exactly what you need in this case.We identified this limitation as important and prepared a fix - in future versions it will be possible to set up CORS both through API and UI. The fix will be a part of next releases:Community Edition - use docker tag dev_latest to get it now or wait for the next major release, no release date set yet Helm chart - wait for the next major release, no release date set yet a new SaaS offering - going to be released in upcoming days, including free trial, first only in AWS

3
jacek
GoodData Employee
1 year ago
A
Aaron DsouzaNew Participant
asked in SDKs and APIs

Application created using Accelerator Toolkit keeps refreshing

Hi Aaron,I just tried to reproduce your issue:I started GoodData.CN Community Edition from the gooddata/gooddata-cn-ce:1.7.2 image I executed  npx @gooddata/create-gooddata-react-app --backend tiger I named the application “demo”, set “http://localhost:3000” as hostname, and set “typescript” as language cd demo yarn start A new tab was opened in my browser waiting for the application to start Because I did not log in into GoodData.CN in my browser before, once the application started successfully, the related browser tab redirected to URL like this: “http://localhost:3000/dex/auth/local?req=pxnwqfthq2jzwkhc56gfxvoc6” Once I logged in, I was redirected back to the Welcome page of the React app So everything seems to be working properly.Do you use the Community Edition or the helm chart deployment?What version of GoodData.CN do you use?  

3
jacek
GoodData Employee
1 year ago
N
nechaldevNew Participant
asked in Administration

Long time dashboard data visualization

Hi Nechaldev,I am not sure what is the main bottleneck in your case. Is the slowness caused by too many requests from KPI to /api endpoints or is it caused by loading too much data from Drill/MySQL?If it is caused by calls to /api, my colleague found an internal issue which may be related and has already been fixed, so you may expect a fix in the upcoming release.If it is caused by loading too much data from Drill/MySQL, then there is no simple solution. MySQL does not perform well with larger data volumes in general. You are right that we download data again if you apply a filter - this is something we plan to improve in the future. The only thing I can offer now is to turn on an additional caching layer by setting dataSource.enableCaching to true and dataSource.cachePath to a Drill schema, where write is enabled. Related DOC:https://www.gooddata.com/developers/cloud-native/doc/1.7/administration/add-data-sources/data-source-managers/drill/#data-source-detailshttps://www.gooddata.com/

1
jacek
GoodData Employee
1 year ago
Z
zmazulaKnown Participant
asked in Dashboards and Reports

GoodData.CN force cache invalidation

This endpoint is exactly what you need for invalidating of all caches.The invalidation is an atomic operation - it changes an internal ID, which is used for calculations of caches IDs. Once changed in a single transaction, new cache IDs are calculated, never in the conflict with the old IDs.Caches are garbage collected asynchronously and automatically, you do not need to take care of it.

2
jacek
GoodData Employee
1 year ago
C
ChananParticipating Frequently
asked in Data sources

Why are column names with __ invalid?

Hi Chanan,unfortunately “__” is the default separator used by our backend to process naming conventions.However, configuration of the separator is a part of the scan dialog in LDM Modeler. You can delete “__” and scan should work properly.

4
jacek
GoodData Employee
2 years ago
B
Bálint BalinaNew Participant
asked in Data sources

Modeler schema size limit?

Hi Bálint,our LDM Modeler is not capable of handling so many datasets generated from so many tables.Honestly, we do not expect users working with so many datasets in single workspace, it would not provide a good user experience (UX) to end users when creating insights, because they would have to search for attributes/facts in list of thousands.Instead, we recommend to generate datasets (LDM) from subset of tables. There are two ways how to achieve that:Scan tables matching a prefix (separate prefixes for tables and views). Then generate datasets (LDM) from the subset of tables. Do forget to specify “separator” correctly, default is double underscore. Scan all tables. Then drag and drop only required tables into canvas to create datasets from them. There is filter box above tables, which you can use to find required tables. It should provide a good-enough UX including generating references once you e.g. add second dataset connected to first dataset.Let me know if my recommendations work

1
jacek
GoodData Employee
2 years ago
A
aleks2022New Participant
asked in Data sources

GD Cloud Native Docker - connectivity issue (timeout)

OK, so this is definitely an issue related to network connectivity.I do not have any issues when connecting from inside the docker container (community edition) to e.g. snowflake in AWS. But we do not have any restrictions in our company network. Where exactly is your docker container running? Where exactly is your Postgres instance running? Could any kind of company network policy block the connection between the docker container and your data sources?

7
R
GoodData Employee
2 years ago
A
aleks2022New Participant
asked in Data sources

GD Cloud Native Docker - connectivity issue (timeout)

Hi Aleks,just guessing - it may be caused by too many tables in the schema, which you specify in the configuration of the data source. How many tables are in the schema?Anyway, can you please use “docker logs” command or watch logs produced in the terminal, where you start GD.CN and paste here any errors you can find there? Error logs related to communication of GD.CN with the Postgres may be produced after the timeout. 

7
R
GoodData Employee
2 years ago
T
tibiNew Participant
asked in Data sources

GD.CN running the same, long running query in multiple parallel sessions

Hi Tibi and Carson,the query looks weird, because it does not contain any aggregation.It looks like you you LDM is not correct - no aggregation in this case means that one of used labels is primary key, so our analytics engine does not generate aggregation. Because we support only single column (attribute/label) primary keys now, I assume that “destination” is the primary key in this case. Is it really correct? I suppose that if you fix the LDM and appropriate aggregation query is generated by our engine, it will be running much faster and this issue won’t manifest.However, generating more and more identical queries running too long is not a correct behavior. I have just created an internal Jira for this issue. Most likely we introduce a configuration for how long report queries can be running and we implement a mechanism for canceling queries running longer than this threshold.

5
D
GoodData Employee
2 years ago
T
tibiNew Participant
asked in Data sources

GD.CN running the same, long running query in multiple parallel sessions

Hi Tibi,can you please copy&paste whole statement(text, not screenshot) for each “type” of long running query?By “type” I mean to group queries by what aggregations are used.

5
D
GoodData Employee
2 years ago
N
NickKKnown Participant
asked in Data sources

GoodData.CN MySQL datasource

Hi Nick,we are going to release the version 1.4 on October 11th.Apache Drill will be supported out of the box, tough it will be marked as experimental feature.Please, wait for the release, upgrade your instance of GoodData.CN and try it!Regards  Jan

1
jacek
GoodData Employee
2 years ago
ashok
ashokKnown Participant
asked in GoodData.UI

Analyze Tab : Connection failed, try again later…

Well, my assumption is that the label “Audience name” is too large (cardinality x avg length).Because the bug I mentioned it is not possible to workaround it like you are trying to do with the filter.Let’s proof the assumption. Please, send me logs from your installation. If it is Community edition, send me all logs from the docker container, if it is K8S deployment, send me logs from result-cache pods.If it is K8S deployment, did you customize correspoding values.yaml file in any way?Also, please, select COUNT DISTINCT as well as AVG LENGTH of “Audience name”, resp. of the underlying column and share it here.If my assumption is correct, there should be a way how to scale up relevant internal services even in your version 1.3, both in Community edition and in K8S.

6
D
GoodData Employee
2 years ago
ashok
ashokKnown Participant
asked in GoodData.UI

Analyze Tab : Connection failed, try again later…

And also sorry for the late response - we all attended GoodData offsite yesterday, where many of us actively participated e.g. with presentations, so we did not have time to track the community.

6
D
GoodData Employee
2 years ago
ashok
ashokKnown Participant
asked in GoodData.UI

Analyze Tab : Connection failed, try again later…

Hi Ashok,I can see that you did not drag and drop anything from the left panel into MEASURES or ROWS and you still get the red bar.Please, try to drag and drop any element from the left panel into MEASURES, save the visualization (report) and prepare a dashboard.Sorry for this annoying bug, it relates to the data preview triggered when you hover your mouse over elements in the left panel and an element is too large (meaning byte size of all values in the element).The bug will be fixed in the next 1.4 release.   Jan

6
D
GoodData Employee
2 years ago
ashok
ashokKnown Participant
asked in Administration

GoodData.CN using BigQuery as data source

Hi Ashok,glad to hear that your GD.CN can finally connect to the data source!It is mandatory that every dataset has primary key in logical data model (LDM). It can be generated from PK in tables, but BigQuery does not support it unfortunately. If you set PKs in LDM, nothing is changed in the PDM or in the data source. PK in LDM is just a hint for our engine, what is the granularity of the dataset.WARNING: PK must consist of single LDM attribute. In the future we plan to support multi-attribute PKsIf you would like the Scan generating PKs automatically, you have to utilize the naming convention we provide and then set the corresponding prefix (Primary key prefix) in Scan dialog in “ADVANCED SETTINGS”.Regards  Jacek 

12
ashok
2 years ago
ashok
ashokKnown Participant
asked in Administration

GoodData.CN using BigQuery as data source

Ashok,sorry for confusing you. This is known issue, which will be fixed in the next release.Basically dataSource/test API is broken in a way that it does not pass “token” property properly.Please, skip using test API and try to register the data source. 

12
ashok
2 years ago
ashok
ashokKnown Participant
asked in Administration

GoodData.CN using BigQuery as data source

Please, try to specify JDBC URL with https prefix like this: jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;

12
ashok
2 years ago
ashok
ashokKnown Participant
asked in Administration

GoodData.CN using BigQuery as data source

Hi Ashok,have you tried to execute the test API before registering data source?curl $ENDPOINT/api/actions/dataSource/test \ -H "Content-Type: application/json" \ -H "Accept: application/json" \ -H "Authorization: Bearer $GDC_API_TOKEN" \ -d '{ "type": "BIGQUERY", "url": "jdbc:bigquery://www.googleapis.com/bigquery/v2:443;OAuthType=0;ProjectId=<projectId>;", "schema": "bq_dataset", "token": "<base64 value calculated from service account JSON>" }' \ -X POST | jq .What is the result?Anyway, please, collect logs from sql-executor PODs representing the failing request and share it here.

12
ashok
2 years ago
ashok
ashokKnown Participant
asked in Administration

GoodData.CN using BigQuery as data source

Regarding the extra-drivers image, if I understand the screenshot correctly, you injected driver files incorrectly.Here is how it should look like:Dockefile: ADD BIGQUERY/SimbaJDBCDriverforGoogleBigQuery42_1.2.19.1023/ /data/BIGQUERY/ ls BIGQUERY/SimbaJDBCDriverforGoogleBigQuery42_1.2.19.1023/ should return JAR files including e.g. GoogleBigQueryJDBC42.jar

12
ashok
2 years ago
ashok
ashokKnown Participant
asked in Administration

GoodData.CN using BigQuery as data source

Ad 1 example from values.yaml: sqlExecutor:     extraDriversInitContainer: xxxxxxx.dkr.ecr.eu-central-1.amazonaws.com/nas/extra-drivers:latest After you execute `base64 -w0 service_account.json`, here is an example of how to test data source definitions.It is described in the DOC.curl $ENDPOINT/api/actions/dataSource/test \  -H "Content-Type: application/json" \  -H "Accept: application/json" \  -H "Authorization: Bearer $GDC_API_TOKEN" \  -d '{      "type": "BIGQUERY",      "url": "jdbc:bigquery://www.googleapis.com/bigquery/v2:443;OAuthType=0;ProjectId=<projectId>;",      "schema": "bq_dataset",      "token": "<base64 value calculated from service account JSON>"  }' \  -X POST | jq .And here is how to register the data source:curl -H "Authorization: Bearer $GDC_API_TOKEN" -s -H "Content-Type: application/vnd.gooddata.api+json" -X POST \-d '{ "data": { "attributes": { "name": "Test", "type": "BIGQUERY", "url": "jdbc:bigquery://www.googleapis.com/bigquer

12
ashok
2 years ago
D
dasteinParticipating Frequently
asked in Data sources

Can't initialize BigQuery connection - "Headless Exception" error

We tried to reproduce your issue in our K8S deployment with multiple replicas of sql-executor, but everything is working properly on our side so far.We are digging deeper and will let you know once we find something interesting.

18
J
2 years ago
D
dasteinParticipating Frequently
asked in Data sources

Can't initialize BigQuery connection - "Headless Exception" error

We tested this setup against our BigQuery instance.We realized that OAuthServiceAcctEmail in URL has no effect unless it is not present at all, then server returns error.So we decided to set it to “noop” value “user@gooddata.com” and not to extract it from service account files.May I kindly ask you test this setup (with noop email in URL) from any Database Management tool like Dbeaver / Datagrip?Let me know if it works against your environment.If it does not work, test it also with correct email in URL.Let me know the results here.Thanks!

18
J
2 years ago
D
dasteinParticipating Frequently
asked in Data sources

Can't initialize BigQuery connection - "Headless Exception" error

sql-executor

18
J
2 years ago
D
dasteinParticipating Frequently
asked in Data sources

Can't initialize BigQuery connection - "Headless Exception" error

We produce a log message starting with “BQ connection config” containing JDBC URL generated by our platform.Can you please find it in your log and comment it here?

18
J
2 years ago
Welcome to the GoodData Community!Cookie settings