Tuesday, October 24

Performing parallel ETL with Greenplum’s gpfdist and external tables

Greenplum
One of the coolest features that Greenplum offers to Data warehousing and Business Intelligence operators as far as ETL is concerned, is the combination of read only external tables with gpfdist, Greenplum's parallel file distribution server. The typical use case for this solution is parallel data loading of text files (coming from etherogeneous sources - databases or applications) into a Greenplum data warehouse. For those of you who want to know more about Greenplum, I suggest that you visit the Greenplum website, download the Community Edition, install it and start testing it. (more…)

EuroPython 2011: “The Python and the Elephant”

International News, United Kingdom News
During EuroPython 2011, the major annual event for Python developers and users in Europe, 2ndQuadrant will deliver a special hands-on training session entitled "The Python and the Elephant".This 4-hour workshop will take place on Thursday June 23 and will cover the two main techniques for writing applications in Python for PostgreSQL: standard client applications using PsycoPG or internal extensions using the PL/Python language for stored procedures. (more…)

PostGIS In Action

Greg's PlanetPostgreSQL, PostgreSQL
I doubt many people can tell you exactly when the first time they read a map was.  Mine was memorable though.  Circa 3rd grade, I went through the usual battery of standardized tests for the first time, which included map reading.  I did pretty bad, which was odd because it was the only section I bombed like that.  Concerned that perhaps I had some sort of learning problem related to spatial data or visualization, a guidance counselor reviewing my scores quizzed me about that section and what I thought of it.  Told her I thought it was pretty neat, and that I was looking forwarding to learning about these "maps" one day.  Turns out, due to a school change and differences in class order between schools, I had never been shown one before the exam.  For (more…)

PostgreSQL agent in SQL Standard committee again

International News, PostgreSQL, Susanne's PlanetPostgreSQL
By always having Peter E. in background I am active in SQL Standard (ISO/IEC 9075) committee since 2008.The membership expired after I switched companies.I got the pleasant news today morning that the German office of my new company extended the membership.This means - I will be PostgreSQL agent in SQL Standard committee again for the next 12 months.And this time - 100% PostgreSQL. My company has no interests to force me to represent others then PostgreSQL.To be exact:DIN is the institute for standardisation in Germany (similar to ANSI in USA or BSI in UK).My company (the office in Germany) got member of DIN for me. Thank you for supporting this.Means I will represent PostgreSQL in DIN and officially I will represent Germany on international level. On international level (ISO) every (more…)

Intel SSD, now off the sh..err, shamed list

Greg's PlanetPostgreSQL, PostgreSQL, United States News
I already did the long conference entry here, so just a quick update:  slides from PGEast are posted and next week I'll be at the increasingly misnamed MySQL Conference in Santa Clara, California.One thing I'm known for now is ranting about cheap Solid State Drives and how they suck for database use.  The Reliable Writes wiki page collects up most of the background here.  The situation the last few years has been that every inexpensive drive on the market does not have a safe write cache for database use.  Every customer of mine who has purchased one of Intel's SSD drives for example, either the X25-M or the not-enterprise-at-all X25-E, has suffered at least one massive data corruption loss.In order to make a flash drive safe, you need to have a battery-backup on the (more…)

Spring 2011 PostgreSQL Conferences, US/Canada

Greg's PlanetPostgreSQL, PostgreSQL, United States News
This week's water falling from the skies isn't turning into snow.  And on days when it's clear, my car is covered with tree pollen.  While they means something different to most people, to me these are the signs that the spring conference season is about to start.  There's a conference in North America during each of the next three months containing serious PostgreSQL content, and this year I'm making each of them.PgEast 2011 takes place in New York City starting just over two weeks from now.  If you're nearby, it's not too late to make travel plans.  The location is so easy to reach via train.  The conference venue is right on top of New York's Penn Station, a major train hub.  All the major East Coast cities from Boston to Richmond are easy rides from (more…)

2ndQuadrant Deutschland – Special Training Opening Bargain

International News, PostgreSQL
We are proud to announce that 2ndQuadrant Deutschland (Germany) officially is registered.As opening bargain ...We offer 11 different German PostgreSQL trainings, workshops and crash courses between March and July in Bielefeld for special prises.Topics are about PostgreSQL Administration, Performance tuning, Replication, Advanced Development, SQL and Database Basics. Our special PostgreSQL for MySQLer training is on the list too.Please contact [email protected] for getting details, schedules and prises.Of course besides trainings we offer the whole 2ndQuadrant portfolio.You want that somebody will visit you and help you with your PostgreSQL System?Then 2ndQuadrant is the right address for you, Just contact us.You want to migrate from another DBMS to PostgreSQL and need help / (more…)

Linux filesystems and PostgreSQL checkpoint benchmarks

Greg's PlanetPostgreSQL, PostgreSQL, United States News
Following up on last month's Tuning Linux for low PostgreSQL Latency, there's now been a giant pile of testing done on two filesystems, three patches, and two sets of kernel tuning parameters run.  The result so far is some interesting new data, and one more committed improvements in this area that are in PostgreSQL 9.1 now (making three total, the other two are monitoring patches).  I'll be speaking about recommended practice next month during one of my talks at PostgreSQL East, and I've submitted something in this area for May's PGCon too.  Here I'll talk a bit more about the dead ends too, while those memories are still fresh.The basic problem here is that the way PostgreSQL uses the operating system cache when writing allows large amounts of data to accumulate.  The (more…)

PostgreSQL training for MySQLers

International News, PostgreSQL
Lots of PostegreSQLer also use MySQL.Lots of MySQLer want to use PostgreSQL too.You are MySQLer and want to get more knowledge about PostgreSQL?2ndQuadrant and me are planning to offer special PostgreSQL trainings forMySQLers / MySQL Administrators.Depending on attendees the training will be in English or German.It is planned to do the first training in Bielefeld area (Germany).Also we are thinking about Amsterdam.Other locations might follow.If you have interests to attend the training just contact me for getting more details.