Red Gate forums :: View topic - data Cleansing-standarizing column,s data
Return to RSS Feed Available

Search  | Usergroups |  Profile |  Messages |  Log in  Register 
Go to product documentation
ANTS Performance Profiler 5
ANTS Performance Profiler 5 forum

data Cleansing-standarizing column,s data

Search in ANTS Performance Profiler 5 forum
Post new topic   Reply to topic
Jump to:  
Author Message

Joined: 02 Nov 2010
Posts: 1

PostPosted: Tue Nov 02, 2010 1:55 pm    Post subject: data Cleansing-standarizing column,s data Reply with quote

i have converted many text,acess,acess,oracle data to sql now i have to perform data cleansing.

i ,m new to SSIS and i don`t know how to use SSIS to perform my data cleansing before ETL. i have used some queries in my SQL to check dirty data,

for gender i found 8 values with (00,11,01,10,001,M) .

similarly, for date of birth
12 invalid dates. 22-Jal-75,1/27/75,27-Apl-77..... 29-Feb-75,31-jun-89 etc.


1)first SSIS read data.

2)if don`t find 0 or 1 in gender send erronous data(00,11,01,10,001,M) to "error table".

3)in "error table", dirty data (00,11,01,10,001,M) should be converted in 0,1

4)after standarization, error table data records should go to original table at its place.

5)Now i will change 0 to male and 1 to female.

6)now i will send complete table of student(stid,name,father,gender,adress,last degree,reg data,dob) to a new table STD_INFO.

7) i will repeat same 1-6 steps for all databases(lahore,karachi,islamabad,peshawar) and then i will integrate STD_INFO tables of all databases into one.

i hope now you can understand what i have to do. Similar case with DOB first dirty data to erronous table after conversion there to original table and then i will check all records at the same time.
Back to top
View user's profile Send private message
Brian Donahue

Joined: 23 Aug 2004
Posts: 6678

PostPosted: Wed Nov 03, 2010 3:34 pm    Post subject: Reply with quote

Please note that this forum is only for support for Red Gate software products. We are not a community for supporting SQL Server issues. We do have a community resource at, and you may get a decent answer if you ask your question on the forums there.

I hope this helps.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic All times are GMT + 1 Hour
Page 1 of 1

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Powered by phpBB © 2001, 2005 phpBB Group