To GoodData homepage

Data sources

Data sources

  • 56 Topics
  • 177 Replies

56 Topics

umernasirr
umernasirrParticipating Frequently
asked in Data sources

There are no tables in the database while connecting to Snowflake DB

Hey GoodData team, I am trying to connect to snowflake from GoodData as a data source. I have successfully connected the two, but not getting any tables in our schema. What could be the problem here, I’ve tried the following Schema Names while connecting: `OP_DEV, PUBLIC, INFORMATION_SCHEMA, op_dev, public, information_schema ` All of them show the same error “There are no tables in the database”. Could you help me out on this, as we’ve been trying to get GoodData and snowflake running for a while now, thank you.     

7
Joseph Heun
GoodData Employee
3 days ago
D
Moderator
Documentation TeamModerator
published in Data sources

Use AWS PrivateLink with GoodData Cloud

We are now able to set up AWS PrivateLink with GoodData Cloud. If you have an AWS account that runs an Amazon Redshift database, you can privately tunnel your data directly to your GoodData analytics.If you want to set up AWS PrivateLink with GoodData, you need to first set up a VPC Endpoint Service on your AWS account. Once you do that, you will get a “service name” that you can provide to us, so that we can finalize setting up your instance of GoodData Cloud to use the private link.This article describes how to set up the VPC Endpoint Service on your AWS account.You need to do the following two steps: Reach out to GoodData support, letting us know you want to set up PrivateLink.We will provide you with your GoodData account ID. You will need this ID for when you are setting up your VPC endpoint. Create a load balancer, see below. Create VPC endpoint service, see below. Pass the name of your VPC endpoint service to us, we will finalize setting up the AWS PrivateLink connection o

501
JaE
5 days ago
umernasirr
umernasirrParticipating Frequently
asked in Data sources

Issues with connecting to Snowflake DB

Hi GoodData, I are having issues with connecting our Gooddata with snowflake as a data source. Following is the error that pops up whenever I are trying to connect, the credentials are all correct I have verified it multiple times. If I change the credentials, it gives me an error about invalid url.Could you help us out on this issue?  Thanks and Regards,Umer Nasir

9
umernasirr
5 days ago
itzzyaseen
itzzyaseenNew Participant
asked in Data sources

Failed to obtain JDBC Connection

Background task failed: Failed to obtain JDBC Connection; nested exception is java.sql.SQLException: Cannot create PoolableConnectionFactory (The TCP/IP connection to the host xxx.xx.xx.xx, port 1433 has failed. Error: "connect timed out. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".): Cannot create PoolableConnectionFactory (The TCP/IP connection to the host xxx.xx.xx.xx, port 1433 has failed. Error: "connect timed out. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".): The TCP/IP connection to the host xxx.xx.xx.xx, port 1433 has failed. Error: "connect timed out. Verify the connection properties. Make sure that an instance of SQL Server is runn

6
Martin Burian
Community Manager
7 days ago
scott.jacobsen
scott.jacobsenParticipating Frequently
asked in Data sources

Are materialized views supported on the cloud native platform?

I added some materialized views to my postgres database, but they are not available to my cloud native LDM. Are they supported?

4
jacek
GoodData Employee
1 month ago
L
LoganNew Participant
asked in Data sources

Best way to connect Notion to GoodData

Hi everyone, I love the Notion software and databasing tool. Does anyone have a good way to connect Notion and GoodData? Thanks in advanced for any guidance you can offer

3
Iva Gasparekova
GoodData Employee
3 months ago
G
giripurnamaNew Participant
asked in Data sources

Data load has been more than 1 hour

Hi, I want to ask for help with the problem of loading data, it's been more than 1 hour but the data is still running? may i ask you to check it? following ID my workspace:kg4pyyy9wyp6levdzrknvwef1ud0rif4PROCESS_ID = d90c146b-0ba3-4c09-b453-526193202263Request id: "data_load_jOWEXaRQXN_5msKfezQb1:iQu8MnjgLtJFWgQn:JXCGBvOCYh2xFIX8" Thank you 

1
Joseph Heun
GoodData Employee
6 months ago
greglindstrom
greglindstromNew Participant
asked in Data sources

BigQuery and loading data

We are new to GoodData and would like to use our connection to BigQuery tables as our data source.   Will we still need to 'load' data into GoodData or can the data remain in BigQuery?  

6
greglindstrom
7 months ago
R
Robin BoltonNew Participant
asked in Data sources

Data in MongoDB

Hello, we store our data in MongoDB database which isn't part of supported sources.We can't replace the database for another, can you advise how else to upload data to GoodData platform?Thank you,Robin

2
Joseph Heun
GoodData Employee
9 months ago
S
GoodData Employee
sherryGoodData Employee
asked in Data sources

the analytics shows old data even after s3 connection was scheduled and ran successfully

I wonder if the mapping is incorrect, causing the dataset not to update. I’ve read the dataset mapping fields documentation but still unsure whether the dataset fields are correctly mappedworkspace id: trw9as5a7ve3ifxH\5tp6dbanxw17vlyrc

4
Moises Morales
GoodData Employee
11 months ago
C
ChananParticipating Frequently
asked in Data sources

Why are column names with __ invalid?

Hello,I have a data model in snowflake that I am trying to import into GoodData. The tables have a few columns that have names like __companyId (two underscores in front of the word comapnyId)When I try to import it in the UI I get a message “Connection failed. Unknown error” - but if I look in the logs I can see the error:com.gooddata.tiger.metadata.service.ldm.model.GenerateLdmNamingException, message=Column name is not aligned with naming conventions name=__COMPANYID separator=__ numOfParts=2 expectedNumOfParts=3I will rename the columns in my data so I can move on, but I would like to know why “__” is invalid in a column name. We use that type of column name quite a lot throughout our data to signify extra data that we added to our data model, so we would like to understand the reasoning behind that.

4
jacek
GoodData Employee
11 months ago
C
ChananParticipating Frequently
asked in Data sources

Snowflake Datasource

I am trying to connect to snowflake.In snowflake I have a database called DATACLOUD. If I do describe warehouses I have only one called COMPUTE_WHSo I created a datasource with the following jdbcjdbc:snowflake://<my account info here>.snowflakecomputing.com/?warehouse=COMPUTE_WH&db=DATACLOUDBut when I hit scan it says: “There are no tables in the schema”I assume my jdbc url is wrong, but I have no idea what the issue is.

10
C
1 year ago
R
Roey SagieNew Participant
asked in Data sources

How do I use google bigquery table with LIST field (STRING REPEATED)

I tries to load data from Google Bigquery table:The process was failed and the log there is this error:com.google.cloud.bigquery.FieldValueList is in unnamed module of loader 'app'; java.lang.String is in module java.base of loader 'bootstrap'The bigquery table has a filed of type STRING REPEATEDSTRING REPEATED

1
Julius Kos
GoodData Employee
1 year ago
Josh Collins
Josh CollinsNew Participant
asked in Data sources

How fast does data typically transfer from BigQuery to GoodData?

While working through optimizing our data loads, I’m needing to confirm, generally speaking, how what transfer speed does GoodData see during data loads. Thanks!

1
Iva Gasparekova
GoodData Employee
1 year ago
B
Bálint BalinaNew Participant
asked in Data sources

Modeler schema size limit?

Hi,Our team is about to integrate gooddata platform into our application. I was trying to build a proof of concept project, but failed to scan the postgresql dataschema.The UI crashes immediately in chrome, with out of memory. In firefox it keeps running with around 9GB memory usage, but frozen even after 30 minutes. Is there a limitation to the number of tables in the schema? Our schema contains 300+ tables currently.Is this a bug, or am I doing something wrong? If so, please suggest me a work around.Steps:- run gooddata/gooddata-cn-ce:latest locally with docker- connect custom datasource via API (POST /api/entities/dataSources)- click connect data on workspace- after a few seconds the google chrome tab crashes with OOMIf I scan only the views, everything works fine. I tried to scan parts of the schema with different prefixes, but that did not load any tables, if I did specify any prefix.Regards,Bálint Balina

1
jacek
GoodData Employee
1 year ago
H
haint73New Participant
asked in Data sources

How can i change data source with docker community edittion

I download and run docker run -i -t -p 3000:3000 -p 54320:5432 -v gd-volume:/data gooddata/gooddata-cn-ce:latest. But i can not change data source because i have no choice to select data source. Can you help me !

2
Iva Gasparekova
GoodData Employee
1 year ago
A
aleks2022New Participant
asked in Data sources

GD Cloud Native Docker - connectivity issue (timeout)

I installed Cloud Native GoodData, Community edition. I followed instructions from here: https://hub.docker.com/r/gooddata/gooddata-cn-ce/I am able to run the docker container and access the application. I was also able to add demo-ds datasource, scan it and create some model out of it.However, when I try to connect to either to an on premise Postgres database or a Snowflake instance, the connection to those datasources are always timing out. Any suggestions how to get around it?Thank you, Aleks

7
R
GoodData Employee
1 year ago
T
tibiNew Participant
asked in Data sources

GD.CN running the same, long running query in multiple parallel sessions

We have noticed that GD.CN initiates 20+ parallel sessions to Vertica, trying to return the entire dataset, while we are not actively running anything. As these sessions trying to return an entire dataset, they are running for hours.Does anybody nkow why is this happening and how to prevent it?

5
D
GoodData Employee
1 year ago
M
Maria ArcilaNew Participant
asked in Data sources

Data update or refresh

Hello, Is there a way to refresh data or update a data data load not based just on defined time, but when the database is updated?Something like on-demand data update?

4
Iva Gasparekova
GoodData Employee
1 year ago
M
Mitesh MakwanaNew Participant
asked in Data sources

Upload CSV

Hi,I am new to the community and trying GoodData.CN Community Edition Docker image for trial.I’ve successfully created a workspace with the sample demo-ds dataset. Everything works fine. However I am struggling to upload my own CSV. Is it possible at all just to drag and drop the CSV to create a data model? I can only see “Import Model from JSON” and “Export model to JSON” options under Logical Data Model.Any help would be really appreciated. Thanks 

1
D
GoodData Employee
1 year ago
L
LenaKnown Participant
asked in Data sources

Data distribution worker failed. Reason: No suitable target projects found to load data.

Hi there,I’m facing an issue that “Data distribution worker failed. Reason: No suitable target projects found to load data.” in service workspace when loading data to all clients.Could you help me take a look? I have no idea on this. Thank you!

2
L
1 year ago
N
NickKKnown Participant
asked in Data sources

GoodData.CN MySQL datasource

Hi! We’re trying to find a way to use our MySQL database as a data source.I’ve been told you guys recommended Apache Drill as a sort of proxy. I’ve successfully interconnected Apache Drill and our MySQL database. I can now query it via Drill’s webUI and console.Now I need to add Drill as a data source to GoodData.CN instance. How can I do that?https://drill.apache.org/docs/using-the-jdbc-driver/Here they say I need to install their JDBC driver on GoodData. Any ideas on how to do that? Or there any other way to use Drill as a data source in GD.CN? Regards, Nick.

1
jacek
GoodData Employee
1 year ago
S
Sumit AgarwalNew Participant
asked in Data sources

Data loading from mysql

Need to load data from MySQL RDS. pls let me know how I can do that.

2
A
1 year ago
D
dasteinParticipating Frequently
asked in Data sources

Can't initialize BigQuery connection - "Headless Exception" error

We’re on the final steps of setting up GoodData.CN, using BigQuery as our data source.Everything has been going according to the documentation, up until the JDBC driver part. It does seem to load, but now we’re getting the following errors:when testing the connection via API:  { "error": "Could not initialize connection to data source; caused by java.sql.SQLException: [JDBC Driver]null; caused by java.awt.HeadlessException", "successful": false}   in the front end:  scan error={\"detail\":\"Could not initialize connection to data source with id = sandbox-analytics-01; caused by java.sql.SQLException: [JDBC Driver]null; caused by java.awt.HeadlessException\",\"status\":400,\"title\":\"Bad Request\",\"traceId\":\"c61e3d6f6bdc4b5c\"}"   and in the k8s pod:  {"ts":"2021-08-23 14:03:55.725","level":"ERROR","logger":"com.zaxxer.hikari.pool.HikariPool","thread":"DefaultDispatcher-worker-2","traceId":"1d81ad1e182ebdab","spanId":"e2268e780ca7b1da","userId":"admin","orgId":"syn","msg":"H

18
J
1 year ago
A
Ajeet RaiNew Participant
asked in Data sources

BigQuery : Data distribution worker failed. Reason: All projects failed to load.

I’m able to load small dataset from the Bigquery warehouse but getting this error for a larger dataset after 5 hours of data loading process. Please help. ====================== Downloading and integrating data ======================2021-06-11T22:00:52.703+0200 [ERROR]: Fail to load projects "[m96k12g0j5jvcn249c4ggj9h8gte2vla]". Reason: Error processing taskId=82223a5d660230b15f266f142fade45a005b5416d04e7842000000d5 status=ERROR messages=TaskMessages:{empty=false,messageBodies=[task exceeded maximum processing time],messages=[TaskMessage:{classValue=task.error.timeout,fromValue=gcfw,time=DateTime:{...}}]}2021-06-11T22:00:52.716+0200 [INFO]: ====================== End of downloading and integrating data ======================2021-06-11T22:00:52.719+0200 [ERROR]: Data distribution worker failed. Reason: All projects failed to load.

4
J
GoodData Employee
1 year ago
Welcome to the GoodData Community!Cookie settings