(์ง„ํ–‰ ๊ธฐ๊ฐ„ : 2022๋…„ 9์›” 05์ผ - 2022๋…„ 10์›” 25์ผ)

#git - project

https://github.com/Kkwon-SB/Bigdata-pippeline-MLfow

์‹œ๋„ & ์—๋Ÿฌ

๋ฉ”๋ชจ๋ฆฌ ๋ถ€์กฑ issue

HDFS์šฉ๋Ÿ‰ ํ™•๋ณด ๊ณผ์ •

Manager ์ „ํ™˜ ์ด์Šˆ

๋™์  ํŒŒํ‹ฐ์…˜

ํŒ€ ๋ฐ์ดํ„ฐ ์ ์žฌ

ํŒŒํ‹ฐ์…˜ ์ž‘์—… ๊ณผ์ • ๋ณ€๊ฒฝ

Shell Script?

๋ฐฐ์šด ๋‚ด์šฉ

Hadoop

Why Hadoop?

HDFS ํœด์ง€ํ†ต

HDFS๊ณ ๊ฐ€์šฉ์„ฑ

SecondaryNameNodeย 

๋„ค์ž„๋…ธ๋“œ & ๋ฐ์ดํ„ฐ๋…ธ๋“œ

ํ•˜๋‘ก๊ณผ ์ฃผํ‚คํผ๊ฐ€ ํ•จ๊ป˜ ์“ฐ์ด๋Š” ์ด์œ 

Yarn์—ญํ•  ๋ฐ ํŠน์ง•

Zookeeper

Zookeeper?

Failover controller๋ž€?

Fencing &Split brain

์ €๋„๋…ธ๋“œ(Journal node)๋ž€?

Hive

Hive?

ํŒŒํ‹ฐ์…˜

External ํ…Œ์ด๋ธ”

๋Š๋‚€์ 

Untitled