Fix new storagepaths not showing in doc detail

Adds step to bare metal setup regarding downloading the required NLTK data

Adds skipping of NLTK data download if the feature appears disabled

Account for plusses in the OCR language setting

Allows disabling NLTK, adds it as a consideration for low power devices

Changes the NLTK language to be based on the Tesseract OCR language, with fallback to the default processing

Allows configuration of the NLTK processing language

Fixes the download and usage of the downloaded data

Missed one mock

Mock out the nltk portions so the data doesn't need to be downloaded

Fixes CI unit testing

Updates the pre-processing of document content to be much more robust, with tokenization, stemming and stop word removal

Update frontend translation strings

Merge pull request #1648 from paperless-ngx/feature-use-celery

Feature: Transition to celery for background tasks

prevent duplicate tourAnchor race condition

Fix tour / slim sidebar compatibility

Merge pull request #1768 from paperless-ngx/chore-update-gotenbreg

Chore: Updates Gotenberg versions

Merge pull request #1644 from paperless-ngx/feature/welcome-tour

Feature: UI Welcome Tour

Slim sidebar compatibility

Fix code style

Add highlighting, move some anchors for visibility

Update translation strings for welcome tour

fix tour placement issues, basic offerTour method

Add admin tour step, remove step titles, cleaner look

Complete welcome tour

Core welcome tour functionality

Merge pull request #1641 from paperless-ngx/feature/slim-sidebar

Feature: slim sidebar

Fix merge conflict

Merge branch 'dev' into feature/slim-sidebar

Updates a few more instances of the container

Updates Gotenberg container to the latest

Re-lock pipenv version to the last working version

Fixes is_relative_to not being availible for 3.8

If the original file containing a barcode was in the temporary scratch dir, move the split files to consume dir

Merge pull request #1754 from NiFNi/feature/change-default-matching-algo

change default matching algo to auto and move to constant

Enable some testing against a real email server to hopefully catch things earlier

Fixes handling of gmail label extension to IMAP

Enables some basic live testing against a tika server with actual sample documents to catch some more errors mocking won't catch

Fix code style

Merge pull request #1692 from paperless-ngx/feature-frontend-update-checking

Feature: frontend update checking settings

Updates to qpdf 11.1.1, pikepdf 6.1.0, and a few other updates

Merge pull request #1744 from paperless-ngx/fix/issue-1725

Fix: allow preview for .csv files

Use text mime type for csv files for browser preview

Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
Co-Authored-By: bin101 <12427722+bin101@users.noreply.github.com>

Fixes migration error if some tasks are defined already

Merge branch 'dev' into feature-use-celery

Merge pull request #1642 from paperless-ngx/feature-qpdf-11

Feature: Upgrade to qpdf 11, pikepdf 6 & ocrmypdf 14

Bump myst-parser from 0.18.0 to 0.18.1

Bumps [myst-parser](https://github.com/executablebooks/MyST-Parser) from 0.18.0 to 0.18.1.
- [Release notes](https://github.com/executablebooks/MyST-Parser/releases)
- [Changelog](https://github.com/executablebooks/MyST-Parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/MyST-Parser/compare/v0.18.0...v0.18.1)

---
updated-dependencies:
- dependency-name: myst-parser
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Fixes django-q still in the Pipfile.lock

Fixes up some issues with the migrations and type mismatches

Update paperless-document.ts

fix: csv recognition by consumer

paperless-ngx detects the file format via the mime-type based on the response of python-magic which rely on the response of the file command.
In version 5.39 (which is shipped with debian bullseye and I think many more non-rolling distributions) of the file command a *.csv will be detected as "application/csv" instead of "text/csv" as in newer versions.

add id to document duplicate error message

When a document is a duplicate, include the title of the existing document in the fail message

Bump leonsteinhaeuser/project-beta-automations from 1.3.0 to 2.0.1

Bumps [leonsteinhaeuser/project-beta-automations](https://github.com/leonsteinhaeuser/project-beta-automations) from 1.3.0 to 2.0.1.
- [Release notes](https://github.com/leonsteinhaeuser/project-beta-automations/releases)
- [Commits](https://github.com/leonsteinhaeuser/project-beta-automations/compare/v1.3.0...v2.0.1)

---
updated-dependencies:
- dependency-name: leonsteinhaeuser/project-beta-automations
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Bump tj-actions/changed-files from 29.0.2 to 31.0.2

Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 29.0.2 to 31.0.2.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v29.0.2...v31.0.2)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Bump actions/checkout from 2 to 3

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Bump actions/setup-python from 3 to 4

Bumps [actions/setup-python](https://github.com/actions/setup-python) from 3 to 4.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1720 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/rxjs-7.5.7

Bump rxjs from 7.5.6 to 7.5.7 in /src-ui

Bumps [rxjs](https://github.com/reactivex/rxjs) from 7.5.6 to 7.5.7.
- [Release notes](https://github.com/reactivex/rxjs/releases)
- [Changelog](https://github.com/ReactiveX/rxjs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/reactivex/rxjs/compare/7.5.6...7.5.7)

---
updated-dependencies:
- dependency-name: rxjs
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1716 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/uuid-9.0.0

Bump uuid from 8.3.2 to 9.0.0 in /src-ui

Bump uuid from 8.3.2 to 9.0.0 in /src-ui

Bumps [uuid](https://github.com/uuidjs/uuid) from 8.3.2 to 9.0.0.
- [Release notes](https://github.com/uuidjs/uuid/releases)
- [Changelog](https://github.com/uuidjs/uuid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/uuidjs/uuid/compare/v8.3.2...v9.0.0)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1717 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/ng2-pdf-viewer-9.1.2

Bump ng2-pdf-viewer from 9.1.0 to 9.1.2 in /src-ui

Bump ng2-pdf-viewer from 9.1.0 to 9.1.2 in /src-ui

Bumps [ng2-pdf-viewer](https://github.com/VadimDez/ng2-pdf-viewer) from 9.1.0 to 9.1.2.
- [Release notes](https://github.com/VadimDez/ng2-pdf-viewer/releases)
- [Changelog](https://github.com/VadimDez/ng2-pdf-viewer/blob/master/CHANGELOG.md)
- [Commits](https://github.com/VadimDez/ng2-pdf-viewer/compare/9.1.0...9.1.2)

---
updated-dependencies:
- dependency-name: ng2-pdf-viewer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1715 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/ngx-color-8.0.3

Bump ngx-color from 8.0.2 to 8.0.3 in /src-ui

Merge pull request #1719 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/concurrently-7.4.0

Bump concurrently from 7.3.0 to 7.4.0 in /src-ui

Bump concurrently from 7.3.0 to 7.4.0 in /src-ui

Bumps [concurrently](https://github.com/open-cli-tools/concurrently) from 7.3.0 to 7.4.0.
- [Release notes](https://github.com/open-cli-tools/concurrently/releases)
- [Commits](https://github.com/open-cli-tools/concurrently/compare/v7.3.0...v7.4.0)

---
updated-dependencies:
- dependency-name: concurrently
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1718 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/types/node-18.7.23

Bump @types/node from 18.7.14 to 18.7.23 in /src-ui

Bumps [@types/node](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/node) from 18.7.14 to 18.7.23.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/node)

---
updated-dependencies:
- dependency-name: "@types/node"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Bump ngx-color from 8.0.2 to 8.0.3 in /src-ui

Bumps [ngx-color](https://github.com/scttcper/ngx-color) from 8.0.2 to 8.0.3.
- [Release notes](https://github.com/scttcper/ngx-color/releases)
- [Commits](https://github.com/scttcper/ngx-color/compare/v8.0.2...v8.0.3)

---
updated-dependencies:
- dependency-name: ngx-color
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1714 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/jest-environment-jsdom-29.1.2

Bump jest-environment-jsdom from 29.0.1 to 29.1.2 in /src-ui

Bump jest-environment-jsdom from 29.0.1 to 29.1.2 in /src-ui

Bumps [jest-environment-jsdom](https://github.com/facebook/jest/tree/HEAD/packages/jest-environment-jsdom) from 29.0.1 to 29.1.2.
- [Release notes](https://github.com/facebook/jest/releases)
- [Changelog](https://github.com/facebook/jest/blob/main/CHANGELOG.md)
- [Commits](https://github.com/facebook/jest/commits/v29.1.2/packages/jest-environment-jsdom)

---
updated-dependencies:
- dependency-name: jest-environment-jsdom
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1708 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/angular/compiler-14.2.4

Update @angular/cli @angular/core

Bump @angular/compiler from 14.2.0 to 14.2.4 in /src-ui

Bumps [@angular/compiler](https://github.com/angular/angular/tree/HEAD/packages/compiler) from 14.2.0 to 14.2.4.
- [Release notes](https://github.com/angular/angular/releases)
- [Changelog](https://github.com/angular/angular/blob/main/CHANGELOG.md)
- [Commits](https://github.com/angular/angular/commits/14.2.4/packages/compiler)

---
updated-dependencies:
- dependency-name: "@angular/compiler"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1707 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/cypress-10.9.0

Bump cypress from 10.7.0 to 10.9.0 in /src-ui

Bump cypress from 10.7.0 to 10.9.0 in /src-ui

Bumps [cypress](https://github.com/cypress-io/cypress) from 10.7.0 to 10.9.0.
- [Release notes](https://github.com/cypress-io/cypress/releases)
- [Changelog](https://github.com/cypress-io/cypress/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/cypress-io/cypress/compare/v10.7.0...v10.9.0)

---
updated-dependencies:
- dependency-name: cypress
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1710 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/bootstrap-5.2.1

Bump bootstrap from 5.2.0 to 5.2.1 in /src-ui

Bump bootstrap from 5.2.0 to 5.2.1 in /src-ui

Bumps [bootstrap](https://github.com/twbs/bootstrap) from 5.2.0 to 5.2.1.
- [Release notes](https://github.com/twbs/bootstrap/releases)
- [Commits](https://github.com/twbs/bootstrap/compare/v5.2.0...v5.2.1)

---
updated-dependencies:
- dependency-name: bootstrap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Merge pull request #1706 from paperless-ngx/dependabot/npm_and_yarn/src-ui/dev/typescript-4.8.4

Bump typescript from 4.7.4 to 4.8.4 in /src-ui

Bump typescript from 4.7.4 to 4.8.4 in /src-ui

Bumps [typescript](https://github.com/Microsoft/TypeScript) from 4.7.4 to 4.8.4.
- [Release notes](https://github.com/Microsoft/TypeScript/releases)
- [Commits](https://github.com/Microsoft/TypeScript/compare/v4.7.4...v4.8.4)

---
updated-dependencies:
- dependency-name: typescript
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Fix python + frontend tests

Handle settings live refresh, unsubscribe subscriptions

Update documentation re. `PAPERLESS_ENABLE_UPDATE_CHECK`

Better migration of update checking settings, offer reload, strip backend_setting from db

Frontend update checking settings

Changes MariaDB encoding to use utf8mb4

Update references to qcluster t celery

Cleans up and documnets installation on bare metal, includes systemd service file for the celery and celery beat

Fix logger location tag

Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>

Updates how task_args and task_kwargs are parsed, adds testing to cover everything I can think of

re-enable frontend tests and fix tasks fixture

Add related_document and direct link from task UI

Filter out old migrated tasks

Add document name & error result parsing to PaperlessTask serializer

Fix tab ids & date parsing

Ensures all existing one to one fields are nulled before altering the field

Fixes migration order back to the right way

Finalizes what the PaperlessTask will look like to the frontend

Add failed tasks badge, better animation

Merge branch 'main' into dev