본문 바로가기

Data Engineering/Spark

[Spark] Zeppelin 설치하기

[root@localhost ~]# wget https://dlcdn.apache.org/zeppelin/zeppelin-0.11.0/zeppelin-0.11.0-bin-all.tgz
[root@localhost ~]# tar zxvf zeppelin-0.11.0-bin-all.tgz
[root@localhost ~]# mv zeppelin-0.11.0-bin-all/ apache-zeppelin

[root@localhost ~]# cd apache-zeppelin/conf
[root@localhost conf]# cp zeppelin-env.sh.template zeppelin-env.sh
[root@localhost conf]# cp zeppelin-site.xml.template zeppelin-site.xml

[root@localhost conf]# $HADOOP_HOME/sbin/start-all.sh

[root@localhost conf]# gedit zeppelin-env.sh

line 19 : export JAVA_HOME=${JAVA_HOME}
line 79 : export SPARK_HOME=${SPARK_HOME}
line 90 : export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
line 94 : export PYSPARK_PYTHON=${SPARK_HOME}/python
line 96 : PYTHONPATH=${SPARK_HOME}/python

Zeppelin start

[root@localhost apache-zeppelin]# bin/zeppelin-daemon.sh start

localhost:8080 접속

Zeppelin에서 간단한 Spark 실행

Zeppelin stop

[root@localhost apache-zeppelin]# bin/zeppelin-daemon.sh stop

 

'Data Engineering > Spark' 카테고리의 다른 글

[Spark] 기본 연산 - 2  (0) 2024.03.21
[Spark] 기본 연산  (0) 2024.03.21
[Spark] Jupyterlab, Spark를 이용한 데이터 전처리  (0) 2024.03.20
[Spark] PySpark  (0) 2024.03.20
[Spark] Spark 다운로드 및 실습  (0) 2024.03.19