To GoodData homepage

Data modeling & Integration

Data modeling & Integration

92 Topics

D
DarinaNew Participant
asked in Data sources

Permanently deleting the whole dataset

Hello! I need to permanently delete a dataset (a previously uploaded .csv file). How do I make that happen?Is the red "Delete" button in the "Manage" -> "Data Sets" -> <data set> section (see screenshot below) sufficient for this purpose? Or is there another way to do it? 

2
D
9 days ago
hanka
hankaParticipating Frequently
asked in Data models

Dates and time zones

Hello!I was reading docs regarding custom time zones as well as custom time dimensions, and I’m still not sure how to deal best with users different time zones and proper display of dates.Most of our users are in Pacific Standard Time zone, however, our data are stored in UTC format. Because by default there’s no support for timestamps, we’re sending only dates to GoodData. But this causes some dates are displayed differently in GoodData and in the main application. For example Apr 21, 2023 - 6:13pm Pacific time displayed in the app is already 22/04/2023 in GoodData (as it’s UTC).One solution I see is to normalize dates from UTC to timezone that should be used in a given workspace for data upload. That would work well if all workspace users were in the same time zone.Would there be any good solution that could work for a workspace that can be used by users in different time zones? So they could see base date displayed in their desired zone? I don’t see how custom time dimension could h

5
Moises Morales
GoodData Employee
4 days ago
hanka
hankaParticipating Frequently
asked in Data models

CSV data upload and big datasets

Hi,My workspaces are populated by ADD bricks that load CSV files stored on S3. As there’s a limit on headers amount in CSV files, which is 250, and not only dataset fields count but also relations to date and other datasets, or additional labels, how can I handle the situation where I’d need more fields? For example if I need a dataset “projects” that already has 200 fact fields, 40 relations to custom date fields, and I’d need to add additional 20 custom fact fields, is there some way to either use more than 1 CSV file to upload data for this dataset or split it to have 2 fact datasets, but use them as if they were one in the reports? Best,Hanna

2
hanka
1 month ago
hanka
hankaParticipating Frequently
asked in Data models

LDM changelog/revisions

Hi!As our LDM is evolving, sometimes, especially in case any errors occur, it would be handy to see historical changes that were made in the model. Is it already available in any way? If not, are there any options that could help automating the process of building some kind of a changelog, like triggering some callback on release brick for example? Best,Hanna

1
Joseph Heun
GoodData Employee
2 months ago
hanka
hankaParticipating Frequently
asked in Data models

Custom date fields and performance

Hello,I want to give our customers a possibility to use custom date fields and as I know that date dimensions consume disk space and if there are too many of them it might have an impact on performance, I’d like to understand better the breadth of possible impact.In our product we have few segments that define basic LDM variations and inside them customer workspaces. Each customer can freely choose how many of available custom date fields they will use, not used will be hidden (marked as deprecated).Considering setup with segments A, B and C, each with a different amount of available custom date fields (let’s say 50, 100 and 150), and customer workspaces where in segment C there is client c1 using many of them and also loading bigger amounts of data, where performance issues can be visible? Will it be on c1 customer workspace only, or maybe on the whole segment, or actually on all segments, for the whole product? Best,Hanna

2
hanka
2 months ago
Virgil
VirgilNew Participant
asked in Data sources

bigQuery multilevel data (json)

We connected to bigquery where we have the data imported following wayhttps://prnt.sc/bjL3_rN6kTLjactivityLevel 2 statusLevel 2 authorization_dateLevel 2 reception_dateLevel 2 received_dateLevel 2 controlled_dateLevel 2 refunded_datebut in gooddata we only see level 1 data such as activity which clearly is not working :))https://prnt.sc/IRbYP9g3PmBchow can we drill down?

1
Julius Kos
GoodData Employee
2 months ago
umernasirr
umernasirrParticipating Frequently
asked in Data sources

There are no tables in the database while connecting to Snowflake DB

Hey GoodData team, I am trying to connect to snowflake from GoodData as a data source. I have successfully connected the two, but not getting any tables in our schema. What could be the problem here, I’ve tried the following Schema Names while connecting: `OP_DEV, PUBLIC, INFORMATION_SCHEMA, op_dev, public, information_schema ` All of them show the same error “There are no tables in the database”. Could you help me out on this, as we’ve been trying to get GoodData and snowflake running for a while now, thank you.     

8
Boris
GoodData Employee
2 months ago
umernasirr
umernasirrParticipating Frequently
asked in Data sources

Issues with connecting to Snowflake DB

Hi GoodData, I are having issues with connecting our Gooddata with snowflake as a data source. Following is the error that pops up whenever I are trying to connect, the credentials are all correct I have verified it multiple times. If I change the credentials, it gives me an error about invalid url.Could you help us out on this issue?  Thanks and Regards,Umer Nasir

9
umernasirr
2 months ago
D
Moderator
Documentation TeamModerator
published in Data sources

Use AWS PrivateLink with GoodData Cloud

We are now able to set up AWS PrivateLink with GoodData Cloud. If you have an AWS account that runs an Amazon Redshift database, you can privately tunnel your data directly to your GoodData analytics.If you want to set up AWS PrivateLink with GoodData, you need to first set up a VPC Endpoint Service on your AWS account. Once you do that, you will get a “service name” that you can provide to us, so that we can finalize setting up your instance of GoodData Cloud to use the private link.This article describes how to set up the VPC Endpoint Service on your AWS account.You need to do the following two steps: Reach out to GoodData support, letting us know you want to set up PrivateLink.We will provide you with your GoodData account ID. You will need this ID for when you are setting up your VPC endpoint. Create a load balancer, see below. Create VPC endpoint service, see below. Pass the name of your VPC endpoint service to us, we will finalize setting up the AWS PrivateLink connection o

1631
JaE
2 months ago
D
davidhParticipating Frequently
asked in Data models

Display view

Hi,i am problem with display view from my DB.I configured data source and use non public schema (custom schema name)After connect over data connector to my DB (in Model) - returns back only tables no views. The user has set permission to select from views.If I try the same situation with just the public schema, I see tables and views.Isn't the problem that I have the view in a different schema than the public? Thank you for your answersBest regardsDavid Haškovec

12
Jan Kos
GoodData Employee
1 month ago
mares
maresParticipating Frequently
asked in Data models

Model query

Hi folks,I'have been reading few posts from the community in order to structure my model. Although have a few questions here.This is my current model Overviewpoc_date_link: contains all FK's from the different tables at date granularity.In this example, a subscription has a start date and end date. Generated all days (date field) for the user subscription, as a user can not perform any action without having a subscription, (as an annotation, among other tables I did not put in the model cause it would be a bit big). Additionally, for A "user", "subscription", "date" created a unique id. Then I disseminated the ID in the other fact tables.This allows me then to associate different table models by that particular id, which then grant me access to all fields. Done it this way as my Model has lots of dates (as I think most models) allowing me to play all metrics around a unique date.Enough introduction, as the rest of the model is kind of the same.My question is regarding dimensions, facts

2
mares
3 months ago
scott.jacobsen
scott.jacobsenParticipating Frequently
asked in Data sources

Are materialized views supported on the cloud native platform?

I added some materialized views to my postgres database, but they are not available to my cloud native LDM. Are they supported?

4
jacek
GoodData Employee
3 months ago
JeffC
JeffCParticipating Frequently
asked in Data models

Updating Data Models when Souece Updated

So I have a postgress database that has been updated to add new columns. However, my data model doesn't seem to pick these up or volunteer that they were found so that I can choose to add them for future loads. Without breaking metrics how can I add the missing columns in the least manual way?  

3
Iva Gasparekova
GoodData Employee
4 months ago
L
LoganNew Participant
asked in Data sources

Best way to connect Notion to GoodData

Hi everyone, I love the Notion software and databasing tool. Does anyone have a good way to connect Notion and GoodData? Thanks in advanced for any guidance you can offer

3
Iva Gasparekova
GoodData Employee
6 months ago
M
MashaKnown Participant
asked in Data models

Moving attributes between datasets

Hello,I have a question about possibility of moving attributes between datasets.Let's say i want to move an attribute Account name from Subscription fact table to Performance dimension table at the LDM level. It seems possible operationally (using a “move” button) but I cannot see how can I map it properly when it lands in the Performance dimension table. Seems like I cannot tell that the data source for this specific column should be another source table (Subscription fact table in this case). If so, what is the purpose behind  a “move” button?My general context is to test how can/can’t I modify my LDM in case any Insights/Dashboards already exist on top of the LDM. And is there any recommended scenario for the approach when I want to populate my workspace with data incrementally?Thank you,  

10
M
7 months ago
G
giripurnamaNew Participant
asked in Data sources

Data load has been more than 1 hour

Hi, I want to ask for help with the problem of loading data, it's been more than 1 hour but the data is still running? may i ask you to check it? following ID my workspace:kg4pyyy9wyp6levdzrknvwef1ud0rif4PROCESS_ID = d90c146b-0ba3-4c09-b453-526193202263Request id: "data_load_jOWEXaRQXN_5msKfezQb1:iQu8MnjgLtJFWgQn:JXCGBvOCYh2xFIX8" Thank you 

1
Joseph Heun
GoodData Employee
8 months ago
greglindstrom
greglindstromNew Participant
asked in Data sources

BigQuery and loading data

We are new to GoodData and would like to use our connection to BigQuery tables as our data source.   Will we still need to 'load' data into GoodData or can the data remain in BigQuery?  

6
greglindstrom
9 months ago
itzzyaseen
itzzyaseenNew Participant
posted in Data sources

Failed to obtain JDBC Connection

Background task failed: Failed to obtain JDBC Connection; nested exception is java.sql.SQLException: Cannot create PoolableConnectionFactory (The TCP/IP connection to the host xxx.xx.xx.xx, port 1433 has failed. Error: "connect timed out. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".): Cannot create PoolableConnectionFactory (The TCP/IP connection to the host xxx.xx.xx.xx, port 1433 has failed. Error: "connect timed out. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".): The TCP/IP connection to the host xxx.xx.xx.xx, port 1433 has failed. Error: "connect timed out. Verify the connection properties. Make sure that an instance of SQL Server is runn

6
Martin Burian
Community Manager
2 months ago
P
PD5Known Participant
asked in Data models

Error when updating data model

Hi, I have a number of similar workspaces that share the same data structure. Recently I have added some fields to the tables in my data warehouse and have changed my data models on Good Data to reflect these changes. This has been fine on 3 workspaces, but on the 4th when I try to save the changes, I receive the following error and the changes are not saved: [{"errorClass":"GDC::Exception::Base","requestId":"modeler_4WjdYDoOXy_DWDqXo0YWP:dOzuVDGsk4yGDtRA:110lnxnig7moh5gy","parameters":["handle_exception","hide_internal"],"component":"Stock::MD","message":"Internal error [%s, %s]."}] Is there any way to fix this? Also, related to this, when saving data model changes - even though the only changes are to add new fields - some calculated metrics and insights are destroyed when saving the changes. It’s nice that there is a warning, but is there any way round this? It would be understandable if I was changing fields that were already in use, but in this case I’m only adding new fields.   

2
P
11 months ago
Kishan
KishanNew Participant
asked in Data models

Is there any way we can use N:M relationship using source column

I go through the documentation but didn’t find a way to establish many to many relationship directly using source column. source:https://help.gooddata.com/doc/enterprise/en/data-integration/data-preparation-and-distribution/data-preparation-and-distribution-pipeline/data-pipeline-reference/automated-data-distribution-reference/naming-convention-for-output-stage-objects 

1
Moises Morales
GoodData Employee
1 year ago
d.novikov
d.novikovParticipating Frequently
asked in Data models

Trying to load a big database into a model leads to browser tab crash

We're trying to load a big database into a model. I can create PDM and LDM through API calls, but when I press the "Create Model" button in the UI a browser tab crashes.Are there any limitations on the database size?

4
R
GoodData Employee
1 year ago
N
nechaldevNew Participant
asked in Data models

Separation of field names

Hello!In our databases, there are fields that are named the same, so when the manager sees the fields in the gooddata in the analytical model, they do not differ in any way, this leads to the fact that you need to spend time determining which particular table this field belongs to. Is it possible to somehow specify a specific field name in a file or through another mechanism so that the fields are named more clearly? For example, according to the template "{Table name} {Field name}".Thanks for understanding. 

1
Joseph Heun
GoodData Employee
1 year ago
P
PD5Known Participant
asked in Data models

Receiving an internal error when publishing data model

I have just cloned a workspace (workspace A) + its data to a new workspace (workspace B). I then created a new PostgreSQL data source which I want to map to the fields in workspace B. The new database is 90% the same as the old one with just a few minor changes.If I just switch the data source on Workspace B, it loses all field mappings and I have to set them all again by hand.To work around this, I have exported the data model from workspace A as a Json file which I have then imported into Workspace B after connecting the new data source. This seems to work and all fields are now mapped as they should be.The differences between the old and new data sources mean I must add a new column in two tables and drop 3 columns in another couple of tables. This seems to go well when editing the data model.However, when I click the publish button I see the following error and the model will not save:[{"message":"Internal error [%s, %s].","requestId":"modeler_EMwODbrZNn_IYHR2xoIsp:Kkpz9mqkiecUeTtG

7
P
1 year ago
O
GoodData Employee
Oldriska ZikovaGoodData Employee
asked in Data models

Comparison of data in GD.CN

We are facing an issue with GD.CN. Our clients need to be able to compare the results of individual generations of data with each other. In order to do that you have the FOR PREVIOUS function is used to create metrics. However, the problem occurs when the data is generated irregularly (for example, once every four days, once every two days, or vice versa five times a day - the spacing is never given). The function cannot take this into account, and in addition the second input argument of the function cannot even work with facts (this also includes the possibility to send information about the spacing between generations from the database to the dataset).Unfortunately, we have not been able to find any other function or way to prove this - how to compare the data of the last generation with its previous generation if the spacing between the generations is irregular?The second part of the problem is the question of whether it is possible to work with smaller time units in GD and display

1
Moises Morales
GoodData Employee
1 year ago
C
Chris MacomberParticipating Frequently
asked in Data models

Error when loading data into column that's not in the data model

Hello,I have a column in one of my tables that I've removed from the data model, but when I try to load the data, it is throwing an error because it can't load data into that column (even though I removed it) because the values are too large for the type. Why is it trying to load data into a column I don't want GoodData to worry about?  Does the Load process load all data regardless of what’s been selected in the Model? Chris

8
C
1 year ago
Welcome to the GoodData Community!Cookie settings