Dataflow vs. Spark: 4 Key Differences to Consider

Dataflow vs. SparkBoth Google Cloud Dataflow and Apache Spark are big data tools that can handle real-time, large-scale data processing. They have similar directed acyclic graph-based (DAG) systems in their core that run jobs in parallel. But while Spark is a cluster-computing framework designed to be fast and fault-tolerant, Dataflow is a fully-managed, cloud-based processing service for […]

BigQuery: Migrating from on-prem PostgreSQL

BigQuery: Migrating from on-prem PostgreSQLMoving Data from On-Prem to BigQuery Nowadays, more and more organizations are using Google Cloud BigQuery to solve their needs for a cloud-based enterprise data warehouse. If you’re one of them, one of the problems you might face is how to move your data from an on-premises (on-prem) solution to Google Cloud Platform without harming […]

The transition generation: Why Millennials need your data to make decisions

millenialsThe Millennial generation is transitioning humanity to a new era, one that will be completely fueled by technology and massively different from what we got used to in the twentieth century. This magnitude of change will be similar to the one after the first Industrial Revolution. In this two-part post, we’ll look at why Millennials […]

Reinvent Your Business with IoT – A Complete Guide

IOTThe Internet of Things (IoT) has developed a lot throughout the past couple of years and there is a growing number of ways to use it for business development. Kick-start your year with discovering how the IoT can transform your business! In this series of blog posts, you will find out how you can: Use […]

5 Good Reasons to Move to a Cloud-based Data Warehouse

cloud-based-data-warehouseThe world of cloud-based Data Warehouses Does your company have a windmill in the parking lot? A nuclear reactor in the basement? A water well in the office kitchen? Of course not. So why then would you operate your own data warehouse? It takes a lot of work. You need tons of hardware, a capacity […]

5 Things You Can Do with Your BigQuery Quota in Google Analytics 360

5 Things You Can Do with Your BigQuery Quota in Google Analytics 360Many companies don’t know that by purchasing Google Analytics 360 suite, they get a free quota of monthly 500 USD. This quota can be used for Google BigQuery usage. Ta direct integration between the two services, so there are plenty of opportunities that an E-Commerce company can leverage. In this blog post, we’ll discover 5 things […]

Data Warehouse in BigQuery  —  Tracking Changes In Dimensions

Data Warehouse in BigQuery  —  Tracking Changes In DimensionsIn this series of blog posts, I’ll describe the difficulties we encountered when we created a data warehouse on BigQuery. This first post is about tracking changes in dimensions. Definitions If you are already familiar with terms used in data warehousing, you can skip this part. Dimension: “A dimension is a structure that categorizes facts […]

How to Boost BigQuery Performance

How to Boost BigQuery PerformanceAs we prepare for our workshop A Big Data Adventure in Google Cloud Platform at Crunch Data Engineering and Analytics Conference, we have started to collect some tips and tricks when it comes to using Google’s Big Data platform. In our previous blog post, we presented some advice about controlling your BigQuery (BQ) costs. Now […]

How to Take Control of Your BigQuery Costs

How to Take Control of Your BigQuery CostsAs we prepare for our workshop “A Big Data Adventure on the Google Cloud Platform” at Crunch Data Engineering and Analytics Conference, we have started to collect some tips and tricks when it comes to using Google’s Big Data platform. This first collection of advice shows how to control your costs when using BigQuery (BQ), […]