dbaspot
Tags Register FAQ Calendar Search Today's Posts Mark Forums Read

data migration question. source & target tables are the same- - Oracle Tools

This is a discussion on data migration question. source & target tables are the same- - Oracle Tools ; I'm doing a one time task of migrating some data from one oracle database into another, bigger, more centralized database in order to consolidate things and make access more convenient. Source and target table definitions are mirror images. However, I'm ...


Home > Database Forum > Oracle Database > Oracle Tools > data migration question. source & target tables are the same-

Reply

 

LinkBack Thread Tools Display Modes
  #1  
Old 11-06-2006, 09:05 AM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default data migration question. source & target tables are the same-

I'm doing a one time task of migrating some data from one oracle
database into another, bigger, more centralized database in order
to consolidate things and make access more convenient. Source and
target table definitions are mirror images. However, I'm not sure of the
best way to proceed with the 2 step process:

1: The source table, which has been in use for a 6 or 8 months, now
has about 50,000 records. Before the migration, 2 fields in each source
table record will need to be populated using data items appearing in
other tables of the target database. (we will be ousting the source
table key of SSN, replacing it with a more benign key item). The second
field is another, internal key, to be used as a future cross reference.
Both tables also store the SSN in an alternate field, in case it will be
needed for future internal verification purposes (so right now at this
point, the source table actually has 2 fields populated with SSN data.
One of these will be replaced with another key during the migration).
SSN data can also be pulled from at least one other table in the target
database, so it can somehow be used for cross referencing purposes.

2: Once these two fields have been replaced, a 'migration wizard'
will be used to move the data.



Step 2 is cake, but I'm not sure how to proceed with step 1. Is there a
shareware or other oracle tool that will let me do this? I believe this
can be done with MS Access but I'm not familiar enough with MS Access
to do it-


Hope the weekend was good-
Bill


Reply With Quote
  #2  
Old 11-06-2006, 01:59 PM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-

Bill wrote:
> I'm doing a one time task of migrating some data from one oracle
> database into another, bigger, more centralized database in order
> to consolidate things and make access more convenient. Source and
> target table definitions are mirror images. However, I'm not sure of the
> best way to proceed with the 2 step process:
>
> 1: The source table, which has been in use for a 6 or 8 months, now
> has about 50,000 records. Before the migration, 2 fields in each source
> table record will need to be populated using data items appearing in
> other tables of the target database. (we will be ousting the source
> table key of SSN, replacing it with a more benign key item). The second
> field is another, internal key, to be used as a future cross reference.
> Both tables also store the SSN in an alternate field, in case it will be
> needed for future internal verification purposes (so right now at this
> point, the source table actually has 2 fields populated with SSN data.
> One of these will be replaced with another key during the migration).
> SSN data can also be pulled from at least one other table in the target
> database, so it can somehow be used for cross referencing purposes.
>
> 2: Once these two fields have been replaced, a 'migration wizard'
> will be used to move the data.
>
>
>
> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there a
> shareware or other oracle tool that will let me do this? I believe this
> can be done with MS Access but I'm not familiar enough with MS Access
> to do it-
>
>
> Hope the weekend was good-
> Bill


Given only 50K records one could accomplish step 1, using SQL*Plus, in
somewhere between 5 and 10 minutes.

But I do take exception to your phrase "benign key item." I'll grant
that an SSN is not the perfect natural key but given only 50K records
it is close enough. What you seem to be considering will guarantee the
introduction of corrupt data or force you to use a unique index to, in
effect, recreate the original key. It sounds like a very bad idea indeed.
--
Daniel A. Morgan
University of Washington
damorgan@x.washington.edu
(replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Reply With Quote
  #3  
Old 11-06-2006, 01:59 PM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-

Bill wrote:
> I'm doing a one time task of migrating some data from one oracle
> database into another, bigger, more centralized database in order
> to consolidate things and make access more convenient. Source and
> target table definitions are mirror images. However, I'm not sure of the
> best way to proceed with the 2 step process:
>
> 1: The source table, which has been in use for a 6 or 8 months, now
> has about 50,000 records. Before the migration, 2 fields in each source
> table record will need to be populated using data items appearing in
> other tables of the target database. (we will be ousting the source
> table key of SSN, replacing it with a more benign key item). The second
> field is another, internal key, to be used as a future cross reference.
> Both tables also store the SSN in an alternate field, in case it will be
> needed for future internal verification purposes (so right now at this
> point, the source table actually has 2 fields populated with SSN data.
> One of these will be replaced with another key during the migration).
> SSN data can also be pulled from at least one other table in the target
> database, so it can somehow be used for cross referencing purposes.
>
> 2: Once these two fields have been replaced, a 'migration wizard'
> will be used to move the data.
>
>
>
> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there a
> shareware or other oracle tool that will let me do this? I believe this
> can be done with MS Access but I'm not familiar enough with MS Access
> to do it-
>
>
> Hope the weekend was good-
> Bill


Given only 50K records one could accomplish step 1, using SQL*Plus, in
somewhere between 5 and 10 minutes.

But I do take exception to your phrase "benign key item." I'll grant
that an SSN is not the perfect natural key but given only 50K records
it is close enough. What you seem to be considering will guarantee the
introduction of corrupt data or force you to use a unique index to, in
effect, recreate the original key. It sounds like a very bad idea indeed.
--
Daniel A. Morgan
University of Washington
damorgan@x.washington.edu
(replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Reply With Quote
  #4  
Old 11-06-2006, 05:03 PM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-

Thanks for tip.
Bill

DA Morgan wrote:
> Bill wrote:
>
>> I'm doing a one time task of migrating some data from one oracle
>> database into another, bigger, more centralized database in order
>> to consolidate things and make access more convenient. Source and
>> target table definitions are mirror images. However, I'm not sure of
>> the best way to proceed with the 2 step process:
>>
>> 1: The source table, which has been in use for a 6 or 8 months, now
>> has about 50,000 records. Before the migration, 2 fields in each
>> source table record will need to be populated using data items
>> appearing in other tables of the target database. (we will be ousting
>> the source table key of SSN, replacing it with a more benign key
>> item). The second field is another, internal key, to be used as a
>> future cross reference.
>> Both tables also store the SSN in an alternate field, in case it will be
>> needed for future internal verification purposes (so right now at this
>> point, the source table actually has 2 fields populated with SSN data.
>> One of these will be replaced with another key during the migration).
>> SSN data can also be pulled from at least one other table in the
>> target database, so it can somehow be used for cross referencing
>> purposes.
>>
>> 2: Once these two fields have been replaced, a 'migration wizard'
>> will be used to move the data.
>>
>>
>>
>> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there
>> a shareware or other oracle tool that will let me do this? I believe
>> this can be done with MS Access but I'm not familiar enough with MS
>> Access to do it-
>>
>>
>> Hope the weekend was good-
>> Bill

>
>
> Given only 50K records one could accomplish step 1, using SQL*Plus, in
> somewhere between 5 and 10 minutes.
>
> But I do take exception to your phrase "benign key item." I'll grant
> that an SSN is not the perfect natural key but given only 50K records
> it is close enough. What you seem to be considering will guarantee the
> introduction of corrupt data or force you to use a unique index to, in
> effect, recreate the original key. It sounds like a very bad idea indeed.


Reply With Quote
  #5  
Old 11-06-2006, 05:03 PM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-

Thanks for tip.
Bill

DA Morgan wrote:
> Bill wrote:
>
>> I'm doing a one time task of migrating some data from one oracle
>> database into another, bigger, more centralized database in order
>> to consolidate things and make access more convenient. Source and
>> target table definitions are mirror images. However, I'm not sure of
>> the best way to proceed with the 2 step process:
>>
>> 1: The source table, which has been in use for a 6 or 8 months, now
>> has about 50,000 records. Before the migration, 2 fields in each
>> source table record will need to be populated using data items
>> appearing in other tables of the target database. (we will be ousting
>> the source table key of SSN, replacing it with a more benign key
>> item). The second field is another, internal key, to be used as a
>> future cross reference.
>> Both tables also store the SSN in an alternate field, in case it will be
>> needed for future internal verification purposes (so right now at this
>> point, the source table actually has 2 fields populated with SSN data.
>> One of these will be replaced with another key during the migration).
>> SSN data can also be pulled from at least one other table in the
>> target database, so it can somehow be used for cross referencing
>> purposes.
>>
>> 2: Once these two fields have been replaced, a 'migration wizard'
>> will be used to move the data.
>>
>>
>>
>> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there
>> a shareware or other oracle tool that will let me do this? I believe
>> this can be done with MS Access but I'm not familiar enough with MS
>> Access to do it-
>>
>>
>> Hope the weekend was good-
>> Bill

>
>
> Given only 50K records one could accomplish step 1, using SQL*Plus, in
> somewhere between 5 and 10 minutes.
>
> But I do take exception to your phrase "benign key item." I'll grant
> that an SSN is not the perfect natural key but given only 50K records
> it is close enough. What you seem to be considering will guarantee the
> introduction of corrupt data or force you to use a unique index to, in
> effect, recreate the original key. It sounds like a very bad idea indeed.


Reply With Quote
  #6  
Old 11-08-2006, 09:59 AM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-



DA Morgan wrote:
> Bill wrote:
>
>> I'm doing a one time task of migrating some data from one oracle
>> database into another, bigger, more centralized database in order
>> to consolidate things and make access more convenient. Source and
>> target table definitions are mirror images. However, I'm not sure of
>> the best way to proceed with the 2 step process:
>>
>> 1: The source table, which has been in use for a 6 or 8 months, now
>> has about 50,000 records. Before the migration, 2 fields in each
>> source table record will need to be populated using data items
>> appearing in other tables of the target database. (we will be ousting
>> the source table key of SSN, replacing it with a more benign key
>> item). The second field is another, internal key, to be used as a
>> future cross reference.
>> Both tables also store the SSN in an alternate field, in case it will be
>> needed for future internal verification purposes (so right now at this
>> point, the source table actually has 2 fields populated with SSN data.
>> One of these will be replaced with another key during the migration).
>> SSN data can also be pulled from at least one other table in the
>> target database, so it can somehow be used for cross referencing
>> purposes.
>>
>> 2: Once these two fields have been replaced, a 'migration wizard'
>> will be used to move the data.
>>
>>
>>
>> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there
>> a shareware or other oracle tool that will let me do this? I believe
>> this can be done with MS Access but I'm not familiar enough with MS
>> Access to do it-
>>
>>
>> Hope the weekend was good-
>> Bill

>
>
> Given only 50K records one could accomplish step 1, using SQL*Plus, in
> somewhere between 5 and 10 minutes.

Actually I took another look at this. Unfortunately, it can't be done
using SQL*Plus.
>
> But I do take exception to your phrase "benign key item." I'll grant
> that an SSN is not the perfect natural key but given only 50K records
> it is close enough.

"Benign" in terms of security.
What you seem to be considering will guarantee the
> introduction of corrupt data or force you to use a unique index to, in
> effect, recreate the original key. It sounds like a very bad idea indeed.


That's because you don't appear to understand it.

take care,
b

Reply With Quote
  #7  
Old 11-08-2006, 09:59 AM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-



DA Morgan wrote:
> Bill wrote:
>
>> I'm doing a one time task of migrating some data from one oracle
>> database into another, bigger, more centralized database in order
>> to consolidate things and make access more convenient. Source and
>> target table definitions are mirror images. However, I'm not sure of
>> the best way to proceed with the 2 step process:
>>
>> 1: The source table, which has been in use for a 6 or 8 months, now
>> has about 50,000 records. Before the migration, 2 fields in each
>> source table record will need to be populated using data items
>> appearing in other tables of the target database. (we will be ousting
>> the source table key of SSN, replacing it with a more benign key
>> item). The second field is another, internal key, to be used as a
>> future cross reference.
>> Both tables also store the SSN in an alternate field, in case it will be
>> needed for future internal verification purposes (so right now at this
>> point, the source table actually has 2 fields populated with SSN data.
>> One of these will be replaced with another key during the migration).
>> SSN data can also be pulled from at least one other table in the
>> target database, so it can somehow be used for cross referencing
>> purposes.
>>
>> 2: Once these two fields have been replaced, a 'migration wizard'
>> will be used to move the data.
>>
>>
>>
>> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there
>> a shareware or other oracle tool that will let me do this? I believe
>> this can be done with MS Access but I'm not familiar enough with MS
>> Access to do it-
>>
>>
>> Hope the weekend was good-
>> Bill

>
>
> Given only 50K records one could accomplish step 1, using SQL*Plus, in
> somewhere between 5 and 10 minutes.

Actually I took another look at this. Unfortunately, it can't be done
using SQL*Plus.
>
> But I do take exception to your phrase "benign key item." I'll grant
> that an SSN is not the perfect natural key but given only 50K records
> it is close enough.

"Benign" in terms of security.
What you seem to be considering will guarantee the
> introduction of corrupt data or force you to use a unique index to, in
> effect, recreate the original key. It sounds like a very bad idea indeed.


That's because you don't appear to understand it.

take care,
b

Reply With Quote
  #8  
Old 11-08-2006, 01:05 PM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-

Bill wrote:
>
>
> DA Morgan wrote:
>> Bill wrote:
>>
>>> I'm doing a one time task of migrating some data from one oracle
>>> database into another, bigger, more centralized database in order
>>> to consolidate things and make access more convenient. Source and
>>> target table definitions are mirror images. However, I'm not sure of
>>> the best way to proceed with the 2 step process:
>>>
>>> 1: The source table, which has been in use for a 6 or 8 months, now
>>> has about 50,000 records. Before the migration, 2 fields in each
>>> source table record will need to be populated using data items
>>> appearing in other tables of the target database. (we will be ousting
>>> the source table key of SSN, replacing it with a more benign key
>>> item). The second field is another, internal key, to be used as a
>>> future cross reference.
>>> Both tables also store the SSN in an alternate field, in case it will be
>>> needed for future internal verification purposes (so right now at
>>> this point, the source table actually has 2 fields populated with SSN
>>> data. One of these will be replaced with another key during the
>>> migration). SSN data can also be pulled from at least one other table
>>> in the target database, so it can somehow be used for cross
>>> referencing purposes.
>>>
>>> 2: Once these two fields have been replaced, a 'migration wizard'
>>> will be used to move the data.
>>>
>>>
>>>
>>> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there
>>> a shareware or other oracle tool that will let me do this? I believe
>>> this can be done with MS Access but I'm not familiar enough with MS
>>> Access to do it-
>>>
>>>
>>> Hope the weekend was good-
>>> Bill

>>
>>
>> Given only 50K records one could accomplish step 1, using SQL*Plus, in
>> somewhere between 5 and 10 minutes.

> Actually I took another look at this. Unfortunately, it can't be done
> using SQL*Plus.
>>
>> But I do take exception to your phrase "benign key item." I'll grant
>> that an SSN is not the perfect natural key but given only 50K records
>> it is close enough.

> "Benign" in terms of security.
> What you seem to be considering will guarantee the
>> introduction of corrupt data or force you to use a unique index to, in
>> effect, recreate the original key. It sounds like a very bad idea indeed.

>
> That's because you don't appear to understand it.
>
> take care,
> b


Au contraire.

It is because I have made those mistakes in the past and paid the price.
--
Daniel A. Morgan
University of Washington
damorgan@x.washington.edu
(replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Reply With Quote
  #9  
Old 11-08-2006, 01:05 PM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-

Bill wrote:
>
>
> DA Morgan wrote:
>> Bill wrote:
>>
>>> I'm doing a one time task of migrating some data from one oracle
>>> database into another, bigger, more centralized database in order
>>> to consolidate things and make access more convenient. Source and
>>> target table definitions are mirror images. However, I'm not sure of
>>> the best way to proceed with the 2 step process:
>>>
>>> 1: The source table, which has been in use for a 6 or 8 months, now
>>> has about 50,000 records. Before the migration, 2 fields in each
>>> source table record will need to be populated using data items
>>> appearing in other tables of the target database. (we will be ousting
>>> the source table key of SSN, replacing it with a more benign key
>>> item). The second field is another, internal key, to be used as a
>>> future cross reference.
>>> Both tables also store the SSN in an alternate field, in case it will be
>>> needed for future internal verification purposes (so right now at
>>> this point, the source table actually has 2 fields populated with SSN
>>> data. One of these will be replaced with another key during the
>>> migration). SSN data can also be pulled from at least one other table
>>> in the target database, so it can somehow be used for cross
>>> referencing purposes.
>>>
>>> 2: Once these two fields have been replaced, a 'migration wizard'
>>> will be used to move the data.
>>>
>>>
>>>
>>> Step 2 is cake, but I'm not sure how to proceed with step 1. Is there
>>> a shareware or other oracle tool that will let me do this? I believe
>>> this can be done with MS Access but I'm not familiar enough with MS
>>> Access to do it-
>>>
>>>
>>> Hope the weekend was good-
>>> Bill

>>
>>
>> Given only 50K records one could accomplish step 1, using SQL*Plus, in
>> somewhere between 5 and 10 minutes.

> Actually I took another look at this. Unfortunately, it can't be done
> using SQL*Plus.
>>
>> But I do take exception to your phrase "benign key item." I'll grant
>> that an SSN is not the perfect natural key but given only 50K records
>> it is close enough.

> "Benign" in terms of security.
> What you seem to be considering will guarantee the
>> introduction of corrupt data or force you to use a unique index to, in
>> effect, recreate the original key. It sounds like a very bad idea indeed.

>
> That's because you don't appear to understand it.
>
> take care,
> b


Au contraire.

It is because I have made those mistakes in the past and paid the price.
--
Daniel A. Morgan
University of Washington
damorgan@x.washington.edu
(replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Reply With Quote
  #10  
Old 11-08-2006, 02:47 PM
Database Bot
 
Join Date: Sep 2009
Posts: 1,236,254
Database Administrator is on a distinguished road
Default Re: data migration question. source & target tables are the same-



DA Morgan wrote:
> Bill wrote:
>
>>
>>>>

>> That's because you don't appear to understand it.
>>
>> take care,
>> b

>
>
> Au contraire.
>
> It is because I have made those mistakes in the past and paid the price.


Well, actually you appear to still be paying the price.

Reply With Quote
Reply

Thread Tools
Display Modes



All times are GMT -4. The time now is 12:12 PM.