Gallery-Archivist/README.md
2024-03-01 19:00:59 +01:00

3.4 KiB

Gallery-Archivist


Please don't upload to GitHub

My try to make a Social media archiving web tool with django and gallery-dl

Features / Roadmap

Note! This is still in early development so stuff will change.

  • Scraping sites
  • Scheduled tasks
  • Site support
  • Media support and previews
    • Flash (With Ruffle)
    • PDF (With HTML embed tag)
    • Image (With HTML img tag)
    • Compressed archive previews
    • other text documents
    • Easy download list of all files of post and user

Usage

Run without Docker

  • Step 1: Clone repo
git clone https://git.aroy-art.com/Aroy/Gallery-Archivist.git
  • Step 2: Change dir to the new cloned repo
cd Gallery-Archivist
  • Step 3: Make a python environment
python3 -m venv venv  
  • Step 4: Activate the new python environment
source ./venv/bin/activate
  • Step 5: Install python dependencies
pip install -r requirements.txt
  • Step 6: Copy environment config file and change it to your liking
cp env-sample .env
  • Step 7: Change directory to ./archivist
cd ./archivist
  • Step 8: Run django server
python3 manage.py runserver

Manual Import Data

It is possible to import data from saved gallery-dl json files

  • Step 1: Make sure that you are in the root folder of the project.

  • Step 2: Make sure to activate the python environment.

source ./venv/bin/activate
  • Step 3: Change directory to ./archivist
cd ./archivist
  • Step 4: Import the json data and media file from gallery-dl
    replace <path> with the path of the folder or json file to import
python manage.py import_data <path>

Development

Without Docker

Note! Instructions are made for a modern linux environment.

  • Step 0: Make sure that you have installed the dependencies.
    You need git, python, python-virtualenv, redis

  • Step 1: Clone repo

git clone https://git.aroy-art.com/Aroy/Gallery-Archivist.git
  • Step 2: Change dir to the new cloned repo
cd Gallery-Archivist
  • Step 3: Make a python environment
python3 -m venv venv  
  • Step 4: Activate the new python environment
source ./venv/bin/activate
  • Step 5: Install python dependencies
pip install -r requirements.txt
  • Step 6: Copy environment config file and change it to your liking
cp env-sample archivist/.env
  • Step 7: Change directory to archivist
cd archivist
  • Step 8: Run django database migrations
python manage.py migrate
  • Step 9: Start the redis server
redis-server
  • Step :10 Open another shell inside of archivist/ folder and start the django server
python3 manage.py runserver
  • Step :11 Open another shell inside of archivist/ folder and start the celery worker
celery -A core worker -l info
  • Step :12 Open another shell inside of archivist/ folder and start the celery beat
celery -A core beat -l info