A tool to archive image galleries from users from different sites
Find a file
2023-12-06 20:08:08 +01:00
.vscode Add: new words to spellchecking 2023-11-10 10:06:51 +01:00
archivist Fix: login redirect to use the 2023-12-06 20:08:08 +01:00
.dockerignore Add: docker ignore file 2023-08-03 18:57:27 +02:00
.gitignore Add: cookie folder to git ignore 2023-10-21 18:29:48 +02:00
docker-compose-dev.yml Add: basic docker-compose file for development 2023-10-21 10:56:24 +02:00
Dockerfile-Dev Add: basic dev dockerfile 2023-10-21 10:51:59 +02:00
env-sample Add: env sample file 2022-09-22 14:06:05 +02:00
gallery-dl.conf Add: tmp gallery-dl config 2023-10-21 19:11:52 +02:00
README.md Fix: removed duplicated steps 2023-10-21 22:24:33 +02:00
requirements.txt Add: "djangorestframework" pip module 2023-10-06 10:03:55 +02:00

Gallery-Archivist


Please don't upload to GitHub

My try to make a Social media archiving web tool with django and gallery-dl

Features / Roadmap

Note! This is still in early development so stuff will change.

  • Scraping sites
  • Scheduled tasks
  • Site support
  • Media support and previews
    • Flash (With Ruffle)
    • PDF (With HTML embed tag)
    • Image (With HTML img tag)
    • other text documents

Usage

Run without Docker

  • Step 1: Clone repo
git clone https://git.aroy-art.com/Aroy/Gallery-Archivist.git
  • Step 2: Change dir to the new cloned repo
cd Gallery-Archivist
  • Step 3: Make a python environment
python3 -m venv venv  
  • Step 4: Activate the new python environment
source ./venv/bin/activate
  • Step 5: Install python dependencies
pip install -r requirements.txt
  • Step 6: Copy environment config file and change it to your liking
cp env-sample .env
  • Step 7: Change directory to ./archivist
cd ./archivist
  • Step 8: Run django server
python3 manage.py runserver

Manual Import Data

It is possible to import data from saved gallery-dl json files

  • Step 1: Make sure that you are in the root folder of the project.

  • Step 2: Make sure to activate the python environment.

source ./venv/bin/activate
  • Step 3: Change directory to ./archivist
cd ./archivist
  • Step 4: Import the json data and media file from gallery-dl
    replace <path> with the path of the folder or json file to import
python manage.py import_data <path>

Development

Without Docker

Note! Instructions are made for a modern linux environment.

  • Step 0: Make sure that you have installed the dependencies.
    You need git, python, python-virtualenv, redis

  • Step 1: Clone repo

git clone https://git.aroy-art.com/Aroy/Gallery-Archivist.git
  • Step 2: Change dir to the new cloned repo
cd Gallery-Archivist
  • Step 3: Make a python environment
python3 -m venv venv  
  • Step 4: Activate the new python environment
source ./venv/bin/activate
  • Step 5: Install python dependencies
pip install -r requirements.txt
  • Step 6: Copy environment config file and change it to your liking
cp env-sample archivist/.env
  • Step 7: Change directory to archivist
cd archivist
  • Step 8: Run django database migrations
python manage.py migrate
  • Step 9: Start the redis server
redis-server
  • Step :10 Open another shell inside of archivist/ folder and start the django server
python3 manage.py runserver
  • Step :11 Open another shell inside of archivist/ folder and start the celery worker
celery -A core worker -l info
  • Step :12 Open another shell inside of archivist/ folder and start the celery beat
celery -A core beat -l info