๊ฐœ์š”

์ด ๋ ˆ์‹œํ”ผ๋ฅผ ์‚ฌ์šฉํ•˜๋ฉด IBM CLOUD OBJECT STORAGE์˜ ํŒŒ์ผ์—์„œ ๋ฐ์ดํ„ฐ๋ฅผ ์ฝ์„ ์ˆ˜ ์žˆ๋Š” DataStage Cloud Object Storage Connector job์„ ์ƒ์„ฑ, ๊ตฌ์„ฑ, ์ปดํŒŒ์ผ ๋ฐ ์‹คํ–‰์„ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

 

์ค€๋น„์‚ฌํ•ญ

  1. IBM Infosphere Information Server Datastage 11.7 fp2 ์ด์ƒ
  2. IBM Cloud Object Storage ๊ณ„์ •

Step-by-step

1. ๊ฐœ์š”

IBM Cloud Object Storage๋Š” ๋†’์€ ๋‚ด๊ตฌ์„ฑ, ๋ณต์›๋ ฅ ๋ฐ ๋ณด์•ˆ์„ ์œ„ํ•ด ์„ค๊ณ„๋œ ํ™•์žฅ์„ฑ์ด ๋›ฐ์–ด๋‚œ ํด๋ผ์šฐ๋“œ ์Šคํ† ๋ฆฌ์ง€ ์„œ๋น„์Šค์ธ IBM-managed cloud service ๋‹ˆ๋‹ค.

Information Server๋Š” IBM Cloud Object Storage์˜ ํŒŒ์ผ์—์„œ ๋ฐ์ดํ„ฐ๋ฅผ ์ฝ๊ณ  ETLย  job ์„ค๊ณ„์— ํ†ตํ•ฉํ•  ์ˆ˜ ์žˆ๋Š” ๋„ค์ดํ‹ฐ๋ธŒ ํด๋ผ์šฐ๋“œ ์˜ค๋ธŒ์ ํŠธ ์Šคํ† ๋ฆฌ์ง€ ์ปค๋„ฅํ„ฐ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

Cloud Object Storage Connector๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ IBM Cloud Object Storage์ €์žฅ์†Œ์—์„œ ์ฝ๊ธฐ ์ž‘์—…์„ ์ˆ˜ํ–‰ํ•˜๋Š” ์ƒ˜ํ”Œ ์‚ฌ์šฉ ์‚ฌ๋ก€๋ฅผ ์—ฌ๊ธฐ์—์„œ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค. ย datastage job ์—๋Š” Cloud Object Storage Connector ๋ฅผย  source stage๋กœย  DB2 Connector ๋ฅผย  target์œผ๋กœ ํ•˜๋ฉฐ, ์—ฌ๊ธฐ์„œ IBM Cloud Object Storage์˜ ํŒŒ์ผ ๋ฐ์ดํ„ฐ๊ฐ€ DB2์— ์žˆ๋Š” ํ…Œ์ด๋ธ”์— ๊ธฐ๋ก๋ฉ๋‹ˆ๋‹ค.

์ด ๋ ˆ์‹œํ”ผ์—์„œ๋Š” Cloud Object Storage Connector์†์„ฑ์„ ๊ตฌ์„ฑํ•˜์—ฌ IBM Cloud Object Storage ๋ฐ์ดํ„ฐ๋ฅผ ์ฝ๋Š” ๋ฐฉ๋ฒ•์„ ๋ณด์—ฌ ๋“œ๋ฆฌ๊ฒ ์Šต๋‹ˆ๋‹ค.

2.ย ย  Cloud Object Storage ์—ฐ๊ฒฐ ์†์„ฑ ๊ตฌ์„ฑ

1) Connection Properties ์— IBM Cloud Object Storage ๊ณ„์ •์˜ Login URL, Access Key, Access Key ๋ฐ Secret Key๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

 

2) ๋ฆฌ์†Œ์Šค ์ธ์Šคํ„ด์Šค ID, API ํ‚ค, ์ง€์—ญ ๋ฐ IAM URL์„ ์ œ๊ณตํ•˜์—ฌ ๋ฆฌ์†Œ์Šค ์ธ์Šคํ„ด์Šค ID ์‚ฌ์šฉ์„ ์˜ˆ๋กœ ์„ ํƒํ•˜์—ฌ IBM Cloud Object Storage ์— ์—ฐ๊ฒฐํ•  ์ˆ˜๋„ ์žˆ์Šต๋‹ˆ๋‹ค.

 

3.ย ย ย ย ย  Cloud Object Storage Connector ์†์„ฑ์„ ๊ตฌ์„ฑํ•˜์—ฌ IBM Cloud Object Storage ์—์„œ ์—ฌ๋Ÿฌ ํŒŒ์ผ์„ ์ฝ๊ธฐ

1) ์ฝ๊ธฐ ๋ชจ๋“œ๋ฅผ ย โ€œRead Multiple files using Wildcardsโ€ ๋กœ ์„ ํƒํ•˜๊ณ  ํŒŒ์ผ์„ ย ์ฝ์–ด์•ผ ํ•˜๋Š” ๋ฒ„ํ‚ท ์ด๋ฆ„์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

2) ํŒŒ์ผ ์ด๋ฆ„ ํŠน์„ฑ์— IBM Cloud Object Storage์—์„œ ๋ฐ์ดํ„ฐ๋ฅผ ์ฝ์–ด์•ผํ•˜๋Š” ์™€์ผ๋“œ ์นด๋“œ๋ฅผ ์ œ๊ณตํ•˜์‹ญ์‹œ์˜ค. ์ง€์›๋˜๋Š” ์™€์ผ๋“œ ์นด๋“œ์—๋Š” * ๋ฐ ? ๊ฐ€ ํฌํ•จ๋ฉ๋‹ˆ๋‹ค. ํŒŒ์ผ ์ด๋ฆ„์— ๋” ๋งŽ์€ ํ•„ํ„ฐ๊ฐ€ ํ•„์š”ํ•œ ๊ฒฝ์šฐโ€œโ€œRead multiple files using Regex Expressionโ€๋ฅผ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

3) ์—ฌ๋Ÿฌ ํŒŒ์ผ ์ฝ๊ธฐ ์˜ต์…˜(multiple files read option)์„ ์‚ฌ์šฉํ•˜๋Š” ๊ฒฝ์šฐ ์™€์ผ๋“œ์นด๋“œ/์ •๊ทœ์‹(wildcard/Regex) ๊ณผ ์ผ์น˜ํ•˜๋Š” ๋ชจ๋“  ํŒŒ์ผ์— ๋™์ผํ•œ ์Šคํ‚ค๋งˆ๊ฐ€ ์žˆ์–ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

4) ํŒŒ์ผ ํ˜•์‹์„ ย CSV๋กœ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค. ํ˜„์žฌ 6๊ฐœ์˜ ํŒŒ์ผ ํ˜•์‹์ด ์ง€์›๋ฉ๋‹ˆ๋‹ค: Delimited, CSV, Parquet, Avro, JSON, Excel. ๋ชจ๋“  ํŒŒ์ผ ํ˜•์‹์€ ์š”๊ตฌ ์‚ฌํ•ญ์— ๋”ฐ๋ผ ์„ ํƒํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

5) ํŒŒ์ผ ํ˜•์‹์„ ์„ ํƒํ•˜๋ฉด ์‚ฌ์šฉ ์š”๊ตฌ ์‚ฌํ•ญ์— ๋”ฐ๋ผ ํ—ค๋”, ๊ตฌ๋ถ„ ๊ธฐํ˜ธ, ๊ฒฌ์  ํ‘œ์‹œ ๋“ฑ๊ณผ ๊ฐ™์€ ์„ ํƒ์  ์„œ์‹ ์†์„ฑ์„ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

7.ย  Output tab์—์„œ ๋‹ค์Œ๊ณผ ๊ฐ™์ด IBM CLOUD OBJECT STORAGE์—์„œ ์ฝ์–ด์•ผ ํ•˜๋Š” ๋ฐ์ดํ„ฐ์˜ ์—ด ์ด๋ฆ„ ๋ฐ ํ˜•์‹ ์„ธ๋ถ€ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

8) DB2 Connector stage ์—์„œ DB2์˜ ํ…Œ์ด๋ธ” ์ด๋ฆ„๊ณผ ์—ฐ๊ฒฐ ์„ธ๋ถ€ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

9) job์„ ์ปดํŒŒ์ผํ•˜๊ณ  ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค. IBM CLOUD OBJECT STORAGE ์— ์žˆ๋Š” ํŒŒ์ผ์˜ ๋ฐ์ดํ„ฐ๋Š”ย  DB2 ์˜ ํ…Œ์ด๋ธ”์— ๊ธฐ๋ก๋ฉ๋‹ˆ๋‹ค.

 

4.ย  ์ฐธ์กฐ

https://www.ibm.com/support/knowledgecenter/SSZJPZ_11.7.0/com.ibm.swg.im.iis.conn.cloudobject.usage.doc/topics/connect_to_cld.html

https://www.ibm.com/support/knowledgecenter/SSZJPZ_11.7.0/com.ibm.swg.im.iis.conn.cloudobject.usage.doc/topics/specifying_read_mode_cld.html

 

๋ณธย  tutorial ์€ ์•„๋ž˜์˜ developerWorks Recipes ๋ฅผ ๋ฒˆ์—ญํ•œ ๊ธ€์ž…๋‹ˆ๋‹ค.

IBM DataStage Cloud Object Storage Connector to read data in a hybrid-cloud environment