Dataflow vs. Spark: 4 Key Differences to Consider

Dataflow vs. SparkReading Time: 5 Minutes Read Dataflow vs. Spark: Both Google Cloud Dataflow and Apache Spark are big data tools that can handle real-time, large-scale data processing. They have similar directed acyclic graph-based (DAG) systems in their core that run jobs in parallel. But while Spark is a cluster-computing framework designed to be fast and fault-tolerant, Dataflow is a fully-managed, cloud-based […]

BigQuery: Migrating from on-prem PostgreSQL

BigQuery: Migrating from on-prem PostgreSQLReading Time: 4 Minutes Read Moving Data from On-Prem to BigQuery Nowadays, more and more organizations are using Google Cloud BigQuery to solve their needs for a cloud-based enterprise data warehouse. If you’re one of them, one of the problems you might face is how to move your data from an on-premises (on-prem) solution to Google Cloud Platform without harming […]

The Millennials: Why they need your data to make decisions

millenialsReading Time: 8 Minutes Read The transition generation-or better known as the Millennials- is transitioning humanity to a new era, one that will be completely fueled by technology and massively different from what we got used to in the twentieth century. This magnitude of change will be similar to the one after the first Industrial Revolution. In this two-part post, […]

Reinvent Your Business with IoT – A Complete Guide

IOTReading Time: 4 Minutes Read The Internet of Things (IoT) has developed a lot throughout the past couple of years and there is a growing number of ways to use it for business development. Kick-start your year with discovering how the IoT can transform your business! In this series of blog posts, you will find out how you can: Use […]

5 Good Reasons to Move to a Cloud-based Data Warehouse

cloud-based-data-warehouseReading Time: 3 Minutes Read The world of cloud-based Data Warehouses Does your company have a windmill in the parking lot? A nuclear reactor in the basement? A water well in the office kitchen? Of course not. So why then would you operate your own data warehouse? It takes a lot of work. You need tons of hardware, a capacity […]

5 Things You Can Do with Your BigQuery Quota in Google Analytics 360

5 Things You Can Do with Your BigQuery Quota in Google Analytics 360Reading Time: 2 Minutes Read Many companies don’t know that by purchasing Google Analytics 360 suite, they get a free quota of monthly 500 USD. This quota can be used for Google BigQuery usage. Ta direct integration between the two services, so there are plenty of opportunities that an E-Commerce company can leverage. In this blog post, we’ll discover 5 things […]

Data Warehouse in BigQuery  —  Tracking Changes In Dimensions

Data Warehouse in BigQuery  —  Tracking Changes In DimensionsReading Time: 5 Minutes Read In this series of blog posts, I’ll describe the difficulties we encountered when we created a data warehouse on BigQuery. This first post is about tracking changes in dimensions. Tracking Changes In Dimensions- Definitions If you are already familiar with terms used in data warehousing, you can skip this part. Dimension: “A dimension is a […]

How to Boost your BigQuery Performance

How to Boost BigQuery PerformanceReading Time: 4 Minutes Read As we prepare for our workshop A Big Data Adventure in Google Cloud Platform at Crunch Data Engineering and Analytics Conference, we have started to collect some tips and tricks when it comes to using Google’s Big Data platform. In our previous blog post, we presented some advice about controlling your BigQuery (BQ) costs. Now […]

How to Take Control of Your BigQuery Costs

How to Take Control of Your BigQuery CostsReading Time: 3 Minutes Read As we prepare for our workshop “A Big Data Adventure on the Google Cloud Platform” at Crunch Data Engineering and Analytics Conference, we have started to collect some tips and tricks when it comes to using Google’s Big Data platform. This first collection of advice shows how to control your costs when using BigQuery (BQ), […]