Data Integration Blog

June 25, 2008

ETL - migration puzzle

Filed under: Data Migration, ETL — Alena Semeshko @ 6:32 am

John Morris’s latest post, where he highlights the difference between data migration and ETL is, in fact, very much to the point. ETL is a much larger concept that needs more effort and time than data migration. Data migration, if properly defined, is a one-way long-term trip of data from one system to another. While ETL not only can be a repeated procedure, but is also much larger in scope, as it includes all sorts of data transformations (from data cleansing and data quality checking to certain elements of business intelligence).

So, if you look closely, the two are considerably different, not even parts of the same process.

May 23, 2008

SugarCRM Data Center for Partners & Enterprises

Filed under: Apatar, Data Integration, Data Migration, SugarCRM — Alena Semeshko @ 1:56 am

News from SugarCRM! The company introduced Sugar Data Center Edition (DCE) a new product line for SugarCRM partners and enterprise customers, a set of provisioning and monitoring tools enabling service providers and large organizations to deploy and manage multiple instances distinct versions of SugarCRM from a centralized management console. Sugar DCE will be delivered in two versions one for partners and one for customers. Sugar DCE for Partners allows SugarCRM resellers and hosting providers to deliver SugarCRM in a Software-as-a-Service (SaaS) model to their customer base. Sugar DCE for Enterprises allows large companies to manage multiple versions of SugarCRM within their company from a single location.

Is SugarCRM already deployed in your company? Do you keep important customer information in a database or legacy CRM and want to migrate that data to your new SugarCRM account? Ever thought of integrating it, or your SalesForce.com customer list with that in your SugarCRM? Working with SugarCRM on a corporate level becomes more and more attractive.

April 29, 2008

Let’s talk data security

Filed under: Data Integration, Data Migration, Data Quality, data security — Alena Semeshko @ 11:49 pm

You are at the stage where you’ve already realized that your company lives and thrives on data (research, development data, customer private data, contact list, spreadsheets and tables etc.). You work so hard and do everything you can to keep your data clean and consolidated, and once you finally have the system that delivers quality at hand, you realize that your data isn’t exactly safe. Bummer! Today, when information is as valuable as it is and companies cannot afford having it stolen, lost or disclosed, information security becomes the critical element and basically the driving force in most business processes.

All potential threats can be divided into external or internal ones. External threats include unauthorized programs (such as worms, Trojan viruses, spy-programs, etc.), and there is really no universal solution that would protect your company from all types of threats, that’s why there are so many specialized tools taking care of each particular problem. These can be efficient, I’ll have to admit. However, it’s the internal threats that usually make companies most vulnerable. And two of the most probable scenarios of information security violation are 1) the deliberate theft of confidential data by authorized users (or so called insiders) and 2) unintentional leak that can be caused by a number of factors (lack of awareness about company’s security policies, for instance).

When creating an information security system, developers try to extend its functional to the maximum so as it would ensure extensive protection. Even operation systems today contain security functions designed to increase the enterprise’s safety level. But this “universality” is unacceptable when speaking of valuable data. A universal security system becomes useless in corporate networks where internal threats (whether intentional or not) prevail.

A recent Forrester survey of 305 security and email professionals revealed some scary but realistic statistics:
1 in 3 companies investigated a breach of confidential data last year.
1 in 4 companies experienced an “embarrassing” leak of confidential information.
1 in 5 emails contains a legal, financial or regulatory risk.

Ways out? Again, a global approach. This article on EbizQ.net suggests Data Loss Prevention (DLP) technologies as a way of securing your most valuable asset and creating transparency by enabling companies to monitor and track the whole data flow. Transparency is good. Transparency is good everywhere actually. Come to think of it, transparency is the key to creating a healthy and productive environment. Even in data integration systems, transparency is a neccessity, allowing you to see where your sensitive data is going, how it’s being transformed and saved and howsecure it is during these transactions. Transparency is another global asset that needs to be integrated into the corporate system o values. You could say, of course, that transparency is just another vague notion (like total security and clean data), perfection hard to achieve, especially for the old market players with set processes. Hard, yes, but not impossible. It’s something to go for. In the end, when your transparency efforts deliver security, it’s your company that will benefit.

So, looks like get transparency equals get security.

p.s. keep in mind, like with anything that has to do with data cleansing, integration and migration, technology usually comes in more handy and much cheaper than employees’ training!

March 13, 2008

Thou Shalt Migrate =)

Filed under: Data Migration — Tags: — Alena Semeshko @ 5:02 am

Back to data migration talk. Although DM might be associated with significant efforts and costs, it’s still better than leaving everything as it is (in a mess).

Here are some reasonable reasons to migrate:

  • Increased compliance
  • Improved functionality
  • Future proofing
  • Reduced total cost of ownership (TCO)
  • Performance, reliability, scaleability
  • Reduced risk of scope cutting, cost overrun, or project delay
  • Improved data consistency across systems, processes, and organization
  • Increased responsiveness to the business

March 12, 2008

Data Migration Talk

Filed under: Data Cleansing, Data Migration, Data Quality — Tags: , — Alena Semeshko @ 4:37 am

CleanUp! You first hear these words as a kid from your parents. Clean Up! When you hear this you usually know you’ve made a mess. Clean Up! This is what you shouldn’t be hearing, or, for that matter, thinking, in regards to your company’s data. Or, at least, if the prospect ever crosses your mind, it shouldn’t look as nasty and unpleasant as it used to in your childhood. =)

But nonetheless, clean up you should. If your source systems and initial data are a mess, of course. The obcession with clean data is only justified in this world of Business Intelligence, where looking at the picture as a whole and thinking big is not an encouraged, yet infrequent occurance anymore, but a requirement.

One of the key elements to having your data clean and having a global view of your organization’s lifecycle is data migration. Wise data migration with an appropriate strategy and the right tools, not the sort where you splash money and remain in the same spot you started.

Anyway, a whitepaper I came across got me thinking about this, so you can download it and check it out for yourself over here. It’s called The Hidden Costs of Data Migration and it touches upon the issue of data migration, whether to employ it or not, and the costs associated with it.

Data migration has become a routine task in IT departments. However, with the need for critical systems to be available 24/7 this has become both increasingly important and difficult. This White Paper will outline the factors that are driving data migration and examine the hidden costs that may be encountered when data is moved.

March 10, 2008

Data Migration Pro

Filed under: Data Migration — Tags: — Alena Semeshko @ 2:56 am

While reading the news this morning, I stumbled upon a link to this new website called DataMigrationPro. Apparently, the new web site is devoted entirely to data migration!

Thoughts upon checking it out: although it’s new and there isn’t too much user activity going on, I think it has enough potential to become a useful data migration database. Looks like a great opportunity for professionals to share knowledge, find relevant information and enrich their networks. There are interest groups and blogs focusing on the key areas of data migration, top data migration-related news and events, and much more.

Data Migration Pro is a global community platform that enables members and organisations to deliver more successful data migration projects by enabling knowledge, opportunities and best-practices to be shared and developed.

Membership is free and we welcome registration from all professionals and organisations connected with the data migration profession

Powered by WordPress