« Another weird monetary world | Main | A Lower Dollar Won't Reverse Manufacturing's Decline »

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Stephen - oh yes! I'd love to see their "justifications" for any of this.

So would I. I'll share whatever response I get, if there is one.

"Prices have not changed substantially in the history of price change recording. There is no good reason to adjust tax rate change points based on consumer purchasing power."

"Historically, we have no record that businesses ever paid taxes more than 2% above what they pay now. Any suggestions that businesses used to pay more are not supported by the data."

Paranoid yet?

"Statistics Canada must be the only statistical agency in the world where the average length of a data series gets shorter with the passage of time."

Actually, in my experience this is the norm just about everywhere. I'm Australian and out data is much the same - after all, most of the new definitions are agreed by international statistical bodies, and national statistical agencies want to 'keep up' with modern techniques.

It's just that users of the data are often happy to ignore it, or don't spend the time finding out about how the data is collected etc.

Why can't we just contract this out to Google?

/agree kailer

So frustrating!!!! I jump at the chance to fill out the survey pop-ups on the StatsCan website just so I can rant at them (I pretend they care) about data revisions, terminated series and the maddening inability to save a data-set for repeated updating. FRED does it so well, why can't they?

Great point Stephen. In the process of blogging, I keep coming across series that end and then restart and it is pretty frustrating.

Thanks for this post, Stephen. I had no idea some of those short series could be patched together with older ones - even if one does have to go down to the cellar, and look in bottom of a locked filing cabinet stuck in a disused lavatory.

I think there's a fear in the public sector of doing the wrong thing or saying the wrong thing, so people would rather do nothing than do something which might be subject to criticism later. So any series that could possibly be criticized gets buried.

I get the impression there are quite a few series like that - at least at the more aggregated levels. Often what happens is there's a change in the way they break things down by industry/occupation/product/etc, but not in the actual total.

Stephen,

I agree with Rumpelstatskin: this is pretty much standard practice across the world. The biggest reason for making changes is quite simply changing economic structures.

Taking the first example you quoted, the purchasing behaviour of producers have changed, which means a price index based on the old weighting will not be accurate going forward. CPIs are changed based on changing household expenditure patterns, and IPIs are changed based on changing production patterns. GDP base years are changed, because some industries emerge and some disappear.

If you don't make the adjustment, your data will be increasingly unrepresentative of reality. I've noticed that many countries are now standardising to a five year cycle of updating their time series. That actually makes it convenient for people like me who have to deal with cross-country analyses.

From a practical perspective, there are standard methodologies to deal with splicing series from different base years, for example this one from the OECD:

http://www.oecd.org/industry/business-stats/36596185.pdf

They're a bit of work, but it gets the job done, especially if nothing else is available.

Sorry, I should add this link as well, which has the formulas:

http://www.oecd.org/std/36871378.pdf

The price index change is just "rebasing". It happens all the time to make price index numbers readable (so indexes don't climb to like 5000). No information is loss.

You can get pre-2010 data that is comparable with the new index by dividing the old series by the 2010 index number and combining it with the new series. E.g. if under the old series 2009=280, 2010=300, then under the new series 2009=93.3, 2010=100.

Fine, except

1) StatsCan doesn't tell you that. For all anyone knows, these series are completely incompatible.
2) If you look up the IPPI, they don't tell you where the old series are or how/if you can splice them
3) Why don't they do the splicing for us and publish the long series?

This is absolutely normal when series are rebased. For example, when the US GDP figures were rebased last summer, all the series apart from the very highest level expenditure components now begin in 1999. The old stuff used to go back to 1947 on a quarterly basis. A couple of years ago the US BLS changed the definition of the average earnings index to all employees from non-supervisory workers. The new series starts in 2010. The BLS is also changing the definition of the US PPI next month.

Just do what everyone else does and splice the old data onto the back of the new data. Either adjust the level if its an index that's been rebased or apply the monthly/quarterly changes in the old series to the back of the new series. There's normally an overlap of a couple of years to check the two series are similar.


I thought it was only me. My contact with Canadian data comes every three years when I revise the Canadian edition of my textbook. What a pain in the ass! I'm continually splicing time series, or making do with time series that are much shorter than I would like, because StatCan can't be bothered to make their numbers useful. Arrggghh.

There seems to be a lot of delay, SC told me the new series on provincial government expenditures and revenues will come out in the next few months for example. But how about coherent series of provincial GDP by industry going back before 1997 ? You can put together two series of nominal provincial GDP and go back to 1984, but there's nothing in real terms. The Conference Board have some going back to 1961...

I thought it was only me.

That's probably a widely-held sentiment.

Stephen,

Interesting piece, thanks. I'm curious as to whether you find these issues to be a recent phenomenon, or is it a pattern that's always existed with SC? Thanks,

This is an old habit, as far as I can tell.

Revising historical data is an expensive undertaking.

StatCan works on cost recovery. The broader market for detailed StatCan socio-economic data wants RECENT data. Please recall that a big chunk of that market believes in things like forecasting (sic) for example.... Please recall that the larger market thinks that a modern economy and policy decisions run on economic impact analysis.

Working Canadian empirical economists need to come up with some clever justification for taking resources from one taxpayer and giving them to another. As special-interest politics seems to be as popular as ever these days, that shouldn't be too difficult.

The comments to this entry are closed.

Search this site

  • Google

    WWW
    worthwhile.typepad.com
Blog powered by Typepad