Posts by: giulio.calacoci

Barman 2.1 and the new –archive option

Barman 2.1 Version 2.1 of Barman, backup and recovery manager for PostgreSQL, was released Thursday, Jan. 5. The new release, along with several bugfixes, introduces preliminary support for the upcoming PostgreSQL 10, and adds the –archive option to the switch-xlog command. switch-xlog –archive The new –archive option is especially useful when setting up a new…

2ndQuadrant speaks at PostgreSQL sessions

On the 22nd of September I attended the 8th edition of the PostgreSQL sessions, a conference in Lyon organised by Dalibo and Oslandia, as a speaker.

PostgreSQL 9.5: IMPORT FOREIGN SCHEMA

import-foreign-schema

The release of PostgreSQL 9.5 is imminent so the time has come to analyse what’s new in this latest version. A very interesting feature of version 9.5 is the ability to import a schema from a remote database, using Foreign Data Wrapper and the IMPORT FOREIGN SCHEMA command.

What’s new about Barman 1.4.0?

tazzine-barman-fondogrigio

The 1.4.0 version of Barman adds new features such as incremental backup and automatic integration with pg_stat_archiver which aim to simplify the life of DBAs and system administrators.

Performing ETL using Kettle with GPFDIST and GPLOAD

Scenario: We have a remote datasource, served by a gpfdist server. We need to import the data in a Greenplum database, while performing some ETL manipulation during the import. It is possible to accomplish this goal with a simple transformation in a few steps using Kettle.

ETL with Kettle and Greenplum – Part Two: importing data

In the first part of this article we have created a job, a database connection and defined the flow in Kettle. In the second part we’ll see how Kettle manages the data import from the CSV files.

ETL with Kettle and Greenplum – Part one: setting up your job.

Recently I have shown you how to perform a data import from a CSV file into a Greenplum database, using Talend Community Edition. In this article I’m going to perform the same task using another ETL tool, Kettle.

ETL with Talend and Greenplum – Part two: data import

In the first part of this tutorial, we have set up all the connections required for creating the job, now we can proceed with data import. Let’s drag and drop inside the visual editor an object named tMap. You can find it on the left, in the instruments palette, inside the “elaboration” folder.

ETL with Talend and Greenplum – Part one: connections

hen working with databases, one of the most common task is to load data from one or more CSV files. Several tools are available to achieve this task. Some are executed via command line, like COPY (using psql), some are more complex, like ETL systems.We will start today with Talend but, in the next weeks, we…