Cara Install Superset Data Visualization di Ubuntu 20.04
Apache Superset adalah aplikasi data visualization berbasis web. Superset digunakan untuk eksplorasi dan visualisasi data dalam berbagai format grafik. Superset dikembangkan di atas bahasa pemrograman Python dan framework Flask. Superset mendukung berbagai engine database seperti MySQL, MariaDB, PostgreSQL, Oracle, SQL Server, Amazon Redshift, Azure MS SQL, dan Big Query.
Tutorial Environment
Server dan software yang digunakan pada tutorial ini:
- OS: Ubuntu Server 20.04
- Python: 3.8
- Web Server: Nginx
- SSL: Let’s Encrypt
- Subdomain: superset.musaamin.my.id
- Superset: v1.3.2
Install Dependensi
Install paket dependensi yang dibutuhkan.
1 | apt install build-essential libssl-dev libffi-dev python3-dev python3-pip libsasl2-dev libldap2-dev libmysqlclient-dev |
Install virtualenv
Install Python virtual environment (virtualenv) dengan menggunakan pip.
1 | pip install virtualenv |
Membuat virtualenv
Membuat user untuk Superset.
1 | adduser superset |
Login sebagai user superset.
1 | su - superset |
Membuat virtualenv dengan nama venv.
1 | virtualenv venv |
Mengaktifkan virtualenv.
1 | source venv/bin/activate |
Install superset
Install superset dan library yang dibutuhkan.
1 2 3 | pip install pillow pip install apache-superset pip install mysqlclient |
Insialisasi database.
1 | superset db upgrade |
Export environment variable untuk superset.
1 | echo "export FLASK_APP=superset" >> ~/.bashrc |
Membuat user admin.
1 | superset fab create-admin |
Load data contoh.
1 | superset load_examples |
Membuat default roles dan permissions.
1 | superset init |
Menguji hasil instalasi Superset dengan menjalankan development server. Untuk menghentikan development server tekan CTRL+C.
1 | superset run -h 0.0.0.0 -p 8088 --with-threads --reload --debugger |
Mengakses Superset yang berjalan di development server pada port 8088.
Keluar dari virtual environment dan user superset.
1 2 | deactivate exit |
Membuat systemd service
Membuat folder untuk log Gunicorn.
1 | mkdir gunicorn-log |
Membuat systemd service file untuk mengatur Superset service.
1 | nano /etc/systemd/system/superset.service |
Masukkan konfigurasi berikut ini:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | [Unit] Description="Apache Superset" After=network.target [Service] User=superset Group=superset WorkingDirectory=/home/superset Environment="PATH=/home/superset/venv/bin" ExecStart=/home/superset/venv/bin/gunicorn -w 4 \ --timeout 120 \ -b unix:/home/superset/gunicorn.sock \ --limit-request-line 0 \ --limit-request-field_size 0 \ --error-logfile /home/superset/gunicorn-log/error.log \ --access-logfile /home/superset/gunicorn-log/access.log \ superset.app:create_app() Restart=on-failure RestartSec=5s [Install] WantedBy=multi-user.target |
Reload systemd daemon.
1 | systemctl daemon-reload |
Menjalankan dan mengaktifkan service saat system boot.
1 2 | systemctl start superset systemctl enable superset |
Mengecek status service Superset.
1 | systemctl status superset |
Hasilnya.
1 2 3 4 5 6 | ● superset.service - "Apache Superset" Loaded: loaded (/etc/systemd/system/superset.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2022-01-11 14:47:19 UTC; 7min ago Main PID: 1949 (gunicorn) Tasks: 13 (limit: 4612) Memory: 510.8M |
Install Nginx
Install Nginx sebagai reverse proxy untuk Superset.
1 | apt install nginx |
Membuat file konfigurasi Nginx server block.
1 | nano /etc/nginx/conf.d/superset.conf |
Masukkan konfigurasi berikut:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 | upstream superset { server unix:/home/superset/gunicorn.sock; } server { listen 80; server_name superset.musaamin.my.id; location / { proxy_pass http://superset/; proxy_http_version 1.1; proxy_set_header Upgrade $http_upgrade; proxy_set_header Connection "upgrade"; proxy_set_header Host $http_host; proxy_set_header X-Real-IP $remote_addr; proxy_set_header X-Forward-For $proxy_add_x_forwarded_for; proxy_set_header X-Forward-Proto http; proxy_set_header X-Nginx-Proxy true; proxy_redirect off; } access_log /var/log/nginx/superset.musaamin.my.id-access.log; error_log /var/log/nginx/superset.musaamin.my.id-error.log; } |
Verifikasi konfigurasi Nginx.
1 | nginx -t |
Hasilnya.
1 2 | nginx: the configuration file /etc/nginx/nginx.conf syntax is ok nginx: configuration file /etc/nginx/nginx.conf test is successful |
Restart dan cek status service Nginx.
1 2 | systemctl restart nginx systemctl status nginx |
Hasilnya.
1 2 3 4 5 6 7 8 9 | ● nginx.service - A high performance web server and a reverse proxy server Loaded: loaded (/lib/systemd/system/nginx.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2022-01-11 15:05:55 UTC; 3s ago Docs: man:nginx(8) Process: 2096 ExecStartPre=/usr/sbin/nginx -t -q -g daemon on; master_process on; (code=exited, status=0/SUCCESS) Process: 2109 ExecStart=/usr/sbin/nginx -g daemon on; master_process on; (code=exited, status=0/SUCCESS) Main PID: 2111 (nginx) Tasks: 3 (limit: 4612) Memory: 3.6M |
Mengakses Superset dengan menggunakan domain.
Install Let’s Encrypt
Install Let’s Encrypt untuk SSL.
1 | apt install python3-certbot-nginx |
Request SSL untuk superset.
1 | certbot --non-interactive -m email@example.com --agree-tos --no-eff-email --nginx -d superset.musaamin.my.id --redirect |
Mengakses Superset dengan protokol HTTPS.
Superset siap untuk digunakan.
Selamat mencoba 🙂
mau nambahin superset_config.py dimana ya min?
coba ikuti dokumentasinya – Configuring Superset
untuk di ubuntu 22 gmana ya caranya? saya coba pake tutorial ini gagal terus
apa pesan errornya?
pak tanya, utk akses dgn subdomain berarti kita harus beli domain dan juga webhosting ? (agar bisa setting dns/routing dgn cpanel)
domain dan vps. di dns record tambahkan subdoman dan masukkan ip vps. di vps install superset.
terimakasih. tanya lagi pak 🙂
1. /etc/systemd/system/superset.service –> bila belum ada dibuat?
2. /etc/nginx/conf.d/superset.conf –> bila belum ada dibuat ? isinya seperti di blog.
3. gunicorn –> apa harus diinstall/sudah terinstall saat install ubuntu.
4. gunicord –> mandatory supaya bisa subdomain superset nya?
Terimakasih pak Musa.
supaya bisa berjalan sebagai service, tidak menggunakan development server.
superset db upgrade
Failed to create app
Traceback (most recent call last):
File “/home/superset/venv/lib/python3.8/site-packages/superset/app.py”, line 37, in create_app
app_initializer.init_app()
File “/home/superset/venv/lib/python3.8/site-packages/superset/initialization/__init__.py”, line 474, in init_app
self.pre_init()
File “/home/superset/venv/lib/python3.8/site-packages/superset/initialization/__init__.py”, line 84, in pre_init
if not os.path.exists(self.config[“DATA_DIR”]):
KeyError: ‘DATA_DIR’
Traceback (most recent call last):
File “/home/superset/venv/bin/superset”, line 8, in
sys.exit(superset())
File “/home/superset/venv/lib/python3.8/site-packages/click/core.py”, line 1157, in __call__
return self.main(*args, **kwargs)
File “/home/superset/venv/lib/python3.8/site-packages/click/core.py”, line 1078, in main
rv = self.invoke(ctx)
File “/home/superset/venv/lib/python3.8/site-packages/click/core.py”, line 1685, in invoke
super().invoke(ctx)
File “/home/superset/venv/lib/python3.8/site-packages/click/core.py”, line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “/home/superset/venv/lib/python3.8/site-packages/click/core.py”, line 783, in invoke
return __callback(*args, **kwargs)
File “/home/superset/venv/lib/python3.8/site-packages/click/decorators.py”, line 33, in new_func
return f(get_current_context(), *args, **kwargs)
File “/home/superset/venv/lib/python3.8/site-packages/flask/cli.py”, line 354, in decorator
app = __ctx.ensure_object(ScriptInfo).load_app()
File “/home/superset/venv/lib/python3.8/site-packages/flask/cli.py”, line 308, in load_app
app = locate_app(import_name, name)
File “/home/superset/venv/lib/python3.8/site-packages/flask/cli.py”, line 235, in locate_app
return find_best_app(module)
File “/home/superset/venv/lib/python3.8/site-packages/flask/cli.py”, line 63, in find_best_app
app = app_factory()
File “/home/superset/venv/lib/python3.8/site-packages/superset/app.py”, line 44, in create_app
raise ex
File “/home/superset/venv/lib/python3.8/site-packages/superset/app.py”, line 37, in create_app
app_initializer.init_app()
File “/home/superset/venv/lib/python3.8/site-packages/superset/initialization/__init__.py”, line 474, in init_app
self.pre_init()
File “/home/superset/venv/lib/python3.8/site-packages/superset/initialization/__init__.py”, line 84, in pre_init
if not os.path.exists(self.config[“DATA_DIR”]):
KeyError: ‘DATA_DIR’
muncul error begiut
sepertinya masalah di DATA_DIR, cek direktorinya.