Author Topic: Data Warehouse - Build or Buy?  (Read 3473 times)

Offline ngalemmo

  • Global Moderator
  • Full Member
  • *****
  • Posts: 7
  • Forum Citizenship: +4/-0
Data Warehouse - Build or Buy?
« on: 30 Aug 2005 04:16:31 am »
Data Warehouse - Build or Buy?

[Admin: oops I've accidentally deleted ngalemmo's original post. Apologies - I will recover from backups shortly]
« Last Edit: 20 Sep 2005 06:26:05 am by COGNOiSe administrator »

Offline cognostechie

  • Statesman
  • ******
  • Posts: 674
  • Forum Citizenship: +43/-0
Re: Data Warehouse - Build or Buy?
« Reply #1 on: 30 Aug 2005 04:45:24 am »
Depends on the objective. What solution is required as the end result.

I have seen many people using SAP trying to implement their BW module only to realise that they spent 100 times more on the implementation cost and got 3/4 crappy cubes that are 100 times less powerful than what Powerplay can give them. The management got fed up of the endless implmentation that went on for 6 months , fired the BW team and brought Powerplay. Some brought Business Objects for report writing.

Some stick to BW because their requirement was basically Data Warehousing and BW is closely integrated with SAP R/3 but not with 3rd party systems. I know Powerplay and BW both so I see the difference. It's good for Data Warehousing but when it comes to BI then it fails. Creating cubes thru SAP BW is a hell of a job, involves 10 components to build the model and manually link them together, even after that, it requires continuous monitoring, tons of configuration if any change is required and they don't even have a front end. They use EXCEL to view the cube, called BEx by them (Business Explorer). They also have a web version but that hardly stands any chance compared to cubes on Upfront. For Ex: if you need to nest one inside another, you need to go back and do some configuration to tell BW what you want, then come back and do the nesting vs. just drag and drop in Upfront.
 
Don't know about Peoplesoft and Siebel but I haven't seen anything more powerful than Powerplay for BI though the solutions provided by ERP companies for Datawarehousing is usually good because they integrate their datawarehousing solutions with their own ERP closely and that's about it.

My experience has always been that one should hire a couple of programmers to write programs to transfer data from Production DB to DW DB and from that point on, use a good BI tool rather than the DW solution provided by the ERP Companies. It is much faster, less implementation cost and less chances of failure. Better cubes thru Powerplay.

If the objective is only report writing and if they already have a report writer in place then choosing their own solutions might be a better idea and run the report writer against their DW database.




Offline sophiak

  • Associate
  • **
  • Posts: 4
  • Forum Citizenship: +1/-0
Re: Data Warehouse - Build or Buy?
« Reply #2 on: 08 Sep 2005 07:51:16 am »
Great post ngalemmo.

Looks like there is much movement and activity amongst the industry heavyweights towards a 'single platform' offering.

http://www.computerworld.com/databasetopics/businessintelligence/story/0,10801,98171,00.html

Certainly I would be attracted to:
- the off-the-shelf solution
- the out-of-the-ONE-box solution
- the obvious integration issues that one might be able to avoid

Tangent: you wouldn't be Nick Galemmo the author would you?

Offline cognostechie

  • Statesman
  • ******
  • Posts: 674
  • Forum Citizenship: +43/-0
Re: Data Warehouse - Build or Buy?
« Reply #3 on: 09 Sep 2005 05:09:21 am »
Sometimes I wonder, what happens if the solutions provided by all the big companies (SAP, Peoplesoft etc) become as good as Cognos in terms of BI.

Would this mean that Cognos will lose business?

Offline ngalemmo

  • Global Moderator
  • Full Member
  • *****
  • Posts: 7
  • Forum Citizenship: +4/-0
Re: Data Warehouse - Build or Buy?
« Reply #4 on: 19 Sep 2005 08:30:26 pm »
To sophiak's tangent... yes.

My personal opinion is to go with best-of-breed and build the data warehouse.  Cognostechie's observations of BW are pretty much in line with what I have seen at other sites. 
In a previous position our team was developing a data warehouse in parallel to an effort to bring up BW to support SAP's APO module.  In this particular case, the R/3 system had been heavily modified.  The data warehouse integrated data from internal factory systems, SAP and Siebel. and was completed in less time than the BW implementation which only had to deal with GL data.
I would imagine if a company could run with SAP straight out of the box (or PeopleSoft for that matter) and had no other external systems to integrate with, there would be great benefit in implementing the vendor's solution.  The other 99.999% of companies out there would be better served considering alternatives.
As for the software vendors, I understand their need for revenue and certainly providing an analytics module allows them to check more boxes on RFP's... but... the industry would be better served if they partnered with ETL and reporting vendors and provided more open, adaptable solutions that any business can live with.


Offline COGNOiSe administrator

  • Administrator
  • Statesman
  • ******
  • Posts: 677
  • Forum Citizenship: +31/-8
    • BrightStar Partners, Inc
Re: Data Warehouse - Build or Buy?
« Reply #5 on: 20 Sep 2005 05:27:57 am »
I am very pleased to also confirm that ngalemmo is indeed Nicholas Galemmo - co-author of "Mastering Data Warehouse Design - Relational and Dimensional Techniques".

Nick graciously accepted an offer to join the COGNOiSe team and is a foundation member+Global Moderator. Not meaning to embarrass him - he brings over 30 years of IT industry experience and has published a host of articles covering data warehouses, systems integration and business intelligence. (Just do a search if you don't believe me!)

I've been pestering him to do a data warehouse/BI blog on COGNOiSe.com...I'd love to hear from the community if they would too (between the 370 of us, I'm sure we can help convince him)! ;)

Cheers,
Jon

Offline cognostechie

  • Statesman
  • ******
  • Posts: 674
  • Forum Citizenship: +43/-0
Re: Data Warehouse - Build or Buy?
« Reply #6 on: 20 Sep 2005 06:13:48 am »
It's really a matter of pride to have such a great personality among us here. I voted for it.

On the other hand, now that his original question has been edited (removed), my earlier post (as a reply to his original question) looks out of place.

Should I blank it out ?
 

Offline COGNOiSe administrator

  • Administrator
  • Statesman
  • ******
  • Posts: 677
  • Forum Citizenship: +31/-8
    • BrightStar Partners, Inc
Re: Data Warehouse - Build or Buy?
« Reply #7 on: 20 Sep 2005 06:18:49 am »
OOPS, I think I might have removed his original question by mistake(!).

Thanks for picking up my boo-boo. I'll try and recover it....(good thing you're on the ball, cognostechie!)

Offline ReportNet Addict

  • Global Moderator
  • Statesman
  • *****
  • Posts: 826
  • Forum Citizenship: +61/-40
  • Creator of the Impact Suite
    • The Impact Suite
Re: Data Warehouse - Build or Buy?
« Reply #8 on: 20 Sep 2005 06:04:31 pm »
Cognoise Administrator,

Why don't you ask ngalemmo to write down a tutorial about how to build a DWH :D I think many of us would be very thankfull to him :D

Offline COGNOiSe administrator

  • Administrator
  • Statesman
  • ******
  • Posts: 677
  • Forum Citizenship: +31/-8
    • BrightStar Partners, Inc
Re: Data Warehouse - Build or Buy?
« Reply #9 on: 20 Sep 2005 07:00:48 pm »
...but I wouldn't want to deny him of his rightful book royalties..... 8) heheheheh

But seriously, if you have a look at the News Box (top of page) one of the last few rss feeds is actually Claudia Imhoff's syndicated blog. As much as I respect Claudia's work, I would much rather read a blog from one of our own members!

VOTE YES!

Offline ReportNet Addict

  • Global Moderator
  • Statesman
  • *****
  • Posts: 826
  • Forum Citizenship: +61/-40
  • Creator of the Impact Suite
    • The Impact Suite
Re: Data Warehouse - Build or Buy?
« Reply #10 on: 20 Sep 2005 07:29:42 pm »
But we all provide him with all our knowledge... That must compensate.. ;)

Offline ngalemmo

  • Global Moderator
  • Full Member
  • *****
  • Posts: 7
  • Forum Citizenship: +4/-0
Re: Data Warehouse - Build or Buy?
« Reply #11 on: 21 Sep 2005 12:27:50 am »
Ok guys... knock it off!   ;D

I've been thinking about doing something, but my problem is time... I have a nasty commute (those of you who have been to Los Angeles and driven the 405 know what I'm talking about) and two kids (4 & 6 years old) at home who control my nights and weekends. 

Hmmm... I don't know... maybe I can skip lunch.    Naaah!

Offline ReportNet Addict

  • Global Moderator
  • Statesman
  • *****
  • Posts: 826
  • Forum Citizenship: +61/-40
  • Creator of the Impact Suite
    • The Impact Suite
Re: Data Warehouse - Build or Buy?
« Reply #12 on: 21 Sep 2005 01:02:15 am »
I live in Rotterdam... So I know what you are suffering.. But...If you love something to do you've got all the time you need ;D

So where are your priorities? with Cognoise or family ?  :P

Offline cognostechie

  • Statesman
  • ******
  • Posts: 674
  • Forum Citizenship: +43/-0
Re: Data Warehouse - Build or Buy?
« Reply #13 on: 21 Sep 2005 02:30:24 am »
I live in Los Angeles and I know what Nick is talking about.

Anyway, Nick, we would love it if you could find the time for this but family first..there I agree with you.

Offline COGNOiSe administrator

  • Administrator
  • Statesman
  • ******
  • Posts: 677
  • Forum Citizenship: +31/-8
    • BrightStar Partners, Inc
Re: Data Warehouse - Build or Buy?
« Reply #14 on: 21 Sep 2005 03:55:46 am »
....hey my two-year old (Samuel) voted YES!  ;)

(I'm with ReportNet Addict - COGNOiSe IS family)
« Last Edit: 21 Sep 2005 03:59:13 am by COGNOiSe administrator »