mirror of
https://github.com/penpot/penpot.git
synced 2026-09-23 20:36:15 +00:00
* ✨ Add storage operation metrics for S3 and buckets Expose Prometheus metrics for the object storage subsystem. The S3 backend now attaches an AWS SDK MetricPublisher that counts API calls, retries and latency per operation and target. The storage layer counts logical operations and deduplication outcomes per Penpot bucket, and the assets handlers count served requests per route. Closes #11676 AI-assisted-by: muse-spark-1.3-contributor * ✨ Fix storage metrics labels, errors and test gaps Address the review findings on the storage metrics commit. Label reads with the object's own backend, count failed asset serving as errors without swallowing them, and cover the failed S3 call, S3 asset path and permission-denied branches with tests. Also share the label helper and reuse the metrics test helper. Closes #11676 AI-assisted-by: muse-spark-1.3-contributor * ✨ Harden storage metrics and fill test gaps Address the second-round review findings on storage metrics. Unknown backends now fail explicitly and count as errors, exists stays paired with its dedup outcome, and the thumbnail, missing storage, expired reads, unknown buckets and write failure paths are covered by tests. Label coercion goes through the shared metrics helper. Closes #11676 AI-assisted-by: muse-spark-1.3-contributor * ✨ Harden storage metrics accuracy and coverage Address the full-branch review findings on storage metrics. Touch and delete emit only on changed rows, reads emit after the backend fetch, unknown backends fail explicitly, and tempfile mismatches count as unauthorized. Publisher nil policy, pairing rules and attempt semantics are documented and covered by tests. Closes #11676 AI-assisted-by: muse-spark-1.3-contributor * ✨ Address full-branch review findings on storage metrics Touch and delete resolve labels from the row, reads stay paired, failures are covered by tests, and logging, ranges and docs are tightened. Includes the label helper unit tests and the retries wording clarification. Closes #11676 AI-assisted-by: muse-spark-1.3-contributor * ⚡ Label touch and del metrics from UPDATE RETURNING The storage metrics change resolved metric labels for touch-object! and del-object! with an extra SELECT per id-based call. Since app.main instruments storage unconditionally, every GC collector and binfile import paid that extra round trip: deleting a team with 10k media objects doubled the storage_object statements exactly on the paths that already process the most rows. touch-object! and del-object! now take only the object id (UUID) and read the labels from the updated row itself via RETURNING id, backend, metadata: one statement, no pre-read, and labels that always match the row actually mutated. del-object! additionally guards on deleted_at IS NULL, so a repeated delete returns false and emits no metric. Also from the review of the full branch: extract the duplicated serve/emit/rethrow block in app.http.assets into one helper; give penpot_storage_s3_timing explicit histogram buckets up to 60s (the default cap at 7.5s hid the slow S3 calls the metric exists for); drop the unused ::target-id config key from the S3 backend and hardcode the :default target label until per-bucket routing lands. AI-assisted-by: glm-5.3-flash * ✨ Harden storage metric recording and definitions The metric definition schema is now closed and declares every key the collectors read: buckets, quantiles, max-age and reg. A typo such as a misspelled ::mdef/buckets used to compile and silently fall back to the default histogram buckets; it now fails at startup. The asset result-label fallback coerced an absent status to 500, so a future serve path without a status would have counted successes as errors. The mapping is now explicit and documented: served below 400, unauthorized for 401/403, not-found for 404, and error for everything else, including an absent status. The never-fail try/catch around metric recording existed four times with drift. One app.metrics/run-safe! helper replaces them: it no-ops on a nil metrics instance and logs the first failure per hint at warn level, then at debug, so a broken setup surfaces once without flooding the log. The S3 publisher keeps its outer try/catch: it is the SDK MetricPublisher contract boundary. AI-assisted-by: glm-5.3-flash * ✨ Make metrics mandatory and run! safe by default Recording a metric must never change the behavior of the operation being measured, so `run!` now catches recording failures itself: the first failure per metric id logs at warn, later ones at debug. This replaces the `run-safe!` helper, whose four copies had drifted, and applies the guarantee to every emit site instead of only storage. The metrics instance precondition is a plain assert, and the collector lookup stays outside the recording guard, so a missing instance fails hard even when asserts are disabled. Metrics is therefore no longer optional: the storage, s3-backend and db-pool schemas require `::mtx/metrics`, and the assets handler cfg always carries it. `wrap-publisher` no longer returns nil for a nil instance, and the db pool wires the prometheus tracker unconditionally. AI-assisted-by: deepseek-v4.1-flash
673 lines
27 KiB
Clojure
673 lines
27 KiB
Clojure
;; This Source Code Form is subject to the terms of the Mozilla Public
|
|
;; License, v. 2.0. If a copy of the MPL was not distributed with this
|
|
;; file, You can obtain one at http://mozilla.org/MPL/2.0/.
|
|
;;
|
|
;; Copyright (c) KALEIDOS SUBSIDIARY SL
|
|
|
|
(ns backend-tests.rpc-management-test
|
|
(:require
|
|
[app.binfile.common :as bfc]
|
|
[app.common.features :as cfeat]
|
|
[app.common.pprint :as pp]
|
|
[app.common.types.shape :as cts]
|
|
[app.common.uuid :as uuid]
|
|
[app.config :as cf]
|
|
[app.db :as db]
|
|
[app.http :as http]
|
|
[app.rpc :as-alias rpc]
|
|
[app.storage :as sto]
|
|
[backend-tests.helpers :as th]
|
|
[backend-tests.storage-test :refer [configure-storage-backend]]
|
|
[buddy.core.bytes :as b]
|
|
[clojure.test :as t]
|
|
[cuerdas.core :as str]
|
|
[datoteka.fs :as fs]
|
|
[datoteka.io :as io]))
|
|
|
|
(t/use-fixtures :once th/state-init)
|
|
(t/use-fixtures :each th/database-reset)
|
|
|
|
(defn- update-file!
|
|
[& {:keys [profile-id file-id changes revn] :or {revn 0}}]
|
|
(let [params {::th/type :update-file
|
|
::rpc/profile-id profile-id
|
|
:id file-id
|
|
:session-id (uuid/random)
|
|
:revn revn
|
|
:vern 0
|
|
:features cfeat/supported-features
|
|
:changes changes}
|
|
out (th/command! params)]
|
|
;; (th/print-result! out)
|
|
(t/is (nil? (:error out)))
|
|
(:result out)))
|
|
|
|
(t/deftest upload-tempfile-returns-fresh-object-for-same-content
|
|
(let [profile (th/create-profile* 1 {:is-active true})
|
|
path (fs/create-tempfile :dir "/tmp/penpot" :prefix "test-upload-tempfile-")
|
|
_ (io/write* path "content")
|
|
params {::th/type :upload-tempfile
|
|
::rpc/profile-id (:id profile)
|
|
:content {:filename "export.png"
|
|
:path path
|
|
:mtype "image/png"
|
|
:size 7}}
|
|
config (assoc cf/config :public-uri "https://example.com/penpot")
|
|
out1 (binding [cf/config config]
|
|
(th/management-command! params))
|
|
out2 (binding [cf/config config]
|
|
(th/management-command! params))]
|
|
(t/is (nil? (:error out1)))
|
|
(t/is (nil? (:error out2)))
|
|
(t/is (str/starts-with? (str (get-in out1 [:result :uri]))
|
|
"https://example.com/penpot/assets/by-id/"))
|
|
(t/is (not= (get-in out1 [:result :id])
|
|
(get-in out2 [:result :id])))))
|
|
|
|
(t/deftest upload-tempfile-rejects-html-content-type
|
|
;; N2-13: upload-tempfile must reject non-allowed content types
|
|
(let [profile (th/create-profile* 1 {:is-active true})
|
|
path (fs/create-tempfile :dir "/tmp/penpot" :prefix "test-upload-tempfile-")
|
|
_ (io/write* path "<script>alert(1)</script>")
|
|
params {::th/type :upload-tempfile
|
|
::rpc/profile-id (:id profile)
|
|
:content {:filename "evil.html"
|
|
:path path
|
|
:mtype "text/html"
|
|
:size 27}}
|
|
out (th/management-command! params)]
|
|
(t/is (some? (:error out)))
|
|
(t/is (= :validation (th/ex-type (:error out))))
|
|
(t/is (= :media-type-not-allowed (th/ex-code (:error out))))))
|
|
|
|
(t/deftest duplicate-file
|
|
(let [storage (-> (:app.storage/storage th/*system*)
|
|
(configure-storage-backend))
|
|
|
|
sobject (sto/put-object! storage {::sto/content (sto/content "content")
|
|
:content-type "text/plain"
|
|
:other "data"})
|
|
profile (th/create-profile* 1 {:is-active true})
|
|
project (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project)})
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project)
|
|
:is-shared true})
|
|
|
|
libl (th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
|
|
mobj (th/create-file-media-object* {:file-id (:id file1)
|
|
:is-local false
|
|
:media-id (:id sobject)})]
|
|
(update-file!
|
|
:file-id (:id file1)
|
|
:profile-id (:id profile)
|
|
:revn 0
|
|
:vern 0
|
|
:changes
|
|
[{:type :add-media
|
|
:object mobj}])
|
|
|
|
(let [data {::th/type :duplicate-file
|
|
::rpc/profile-id (:id profile)
|
|
:file-id (:id file1)
|
|
:name "file 1 (copy)"}
|
|
out (th/command! data)]
|
|
|
|
;; (th/print-result! out)
|
|
|
|
;; Check that result is correct
|
|
(t/is (nil? (:error out)))
|
|
(let [result (:result out)]
|
|
;; Check that the returned result is a file but has different id
|
|
;; and different name.
|
|
(t/is (= "file 1 (copy)" (:name result)))
|
|
(t/is (not= (:id file1) (:id result)))
|
|
|
|
;; Check that the new file has a correct file library relation
|
|
(let [[item :as rows] (th/db-query :file-library-rel {:file-id (:id result)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:id file2) (:library-file-id item))))
|
|
|
|
;; Check that the new file has a correct file media objects
|
|
(let [[item :as rows] (th/db-query :file-media-object {:file-id (:id result)})]
|
|
(t/is (= 1 (count rows)))
|
|
|
|
;; Check that both items have different ids
|
|
(t/is (not= (:id item) (:id mobj)))
|
|
|
|
;; check that both file-media-objects points to the same storage object.
|
|
(t/is (= (:media-id item) (:media-id mobj)))
|
|
(t/is (= (:media-id item) (:id sobject)))
|
|
|
|
;; Check if media correctly contains the new file-media-object id
|
|
(t/is (contains? (get-in result [:data :media]) (:id item)))
|
|
|
|
;; And does not contains the old one
|
|
(t/is (not (contains? (get-in result [:data :media]) (:id mobj)))))
|
|
|
|
;; Check the total number of files
|
|
(let [rows (th/db-query :file {:project-id (:id project)})]
|
|
(t/is (= 3 (count rows))))))))
|
|
|
|
(t/deftest duplicate-file-with-deleted-relations
|
|
(let [storage (-> (:app.storage/storage th/*system*)
|
|
(configure-storage-backend))
|
|
sobject (sto/put-object! storage {::sto/content (sto/content "content")
|
|
:content-type "text/plain"
|
|
:other "data"})
|
|
profile (th/create-profile* 1 {:is-active true})
|
|
|
|
project (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project)})
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project)
|
|
:is-shared true})
|
|
|
|
libl (th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
|
|
mobj (th/create-file-media-object* {:file-id (:id file1)
|
|
:is-local false
|
|
:media-id (:id sobject)})]
|
|
|
|
(th/mark-file-deleted* {:id (:id file2)})
|
|
(sto/del-object! storage (:id sobject))
|
|
|
|
(let [data {::th/type :duplicate-file
|
|
::rpc/profile-id (:id profile)
|
|
:file-id (:id file1)
|
|
:name "file 1 (copy)"}
|
|
out (th/command! data)]
|
|
|
|
;; (th/print-result! out)
|
|
|
|
;; Check that result is correct
|
|
(t/is (nil? (:error out)))
|
|
(let [result (:result out)]
|
|
|
|
;; Check that the returned result is a file but has different id
|
|
;; and different name.
|
|
(t/is (= "file 1 (copy)" (:name result)))
|
|
(t/is (not= (:id file1) (:id result)))
|
|
|
|
;; Check that there are no relation to a deleted library
|
|
(let [[item :as rows] (th/db-query :file-library-rel {:file-id (:id result)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; Check that the new file has no media objects
|
|
(let [[item :as rows] (th/db-query :file-media-object {:file-id (:id result)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; Check the total number of files
|
|
(let [rows (th/db-query :file {:project-id (:id project)})]
|
|
(t/is (= 3 (count rows))))))))
|
|
|
|
(t/deftest duplicate-project
|
|
(let [storage (-> (:app.storage/storage th/*system*)
|
|
(configure-storage-backend))
|
|
|
|
sobject (sto/put-object! storage {::sto/content (sto/content "content")
|
|
:content-type "text/plain"
|
|
:other "data"})
|
|
|
|
profile (th/create-profile* 1 {:is-active true})
|
|
project (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project)})
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project)
|
|
:is-shared true})
|
|
|
|
libl (th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
mobj (th/create-file-media-object* {:file-id (:id file1)
|
|
:is-local false
|
|
:media-id (:id sobject)})]
|
|
|
|
(update-file!
|
|
:file-id (:id file1)
|
|
:profile-id (:id profile)
|
|
:revn 0
|
|
:vern 0
|
|
:changes
|
|
[{:type :add-media
|
|
:object mobj}])
|
|
|
|
(let [data {::th/type :duplicate-project
|
|
::rpc/profile-id (:id profile)
|
|
:project-id (:id project)
|
|
:name "project 1 (copy)"}
|
|
out (th/command! data)]
|
|
|
|
;; Check that result is correct
|
|
(t/is (nil? (:error out)))
|
|
|
|
(let [result (:result out)]
|
|
;; Check that they are the same project but different id and name
|
|
(t/is (= "project 1 (copy)" (:name result)))
|
|
(t/is (not= (:id project) (:id result)))
|
|
|
|
;; Check the total number of projects (previously is 2, now is 3)
|
|
(let [rows (th/db-query :project {:team-id (:default-team-id profile)})]
|
|
(t/is (= 3 (count rows))))
|
|
|
|
;; Check that the new project has the same files
|
|
(let [p1-files (th/db-query :file
|
|
{:project-id (:id project)}
|
|
{:order-by [:name]})
|
|
p2-files (th/db-query :file
|
|
{:project-id (:id result)}
|
|
{:order-by [:name]})]
|
|
(t/is (= (count p1-files)
|
|
(count p2-files)))
|
|
|
|
;; check that the both files are equivalent
|
|
(doseq [[fa fb] (map vector p1-files p2-files)]
|
|
(t/is (not= (:id fa) (:id fb)))
|
|
(t/is (= (:name fa) (:name fb)))))))))
|
|
|
|
(t/deftest duplicate-project-with-deleted-files
|
|
(let [storage (-> (:app.storage/storage th/*system*)
|
|
(configure-storage-backend))
|
|
sobject (sto/put-object! storage {::sto/content (sto/content "content")
|
|
:content-type "text/plain"
|
|
:other "data"})
|
|
profile (th/create-profile* 1 {:is-active true})
|
|
project (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project)})
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project)
|
|
:is-shared true})
|
|
|
|
libl (th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
mobj (th/create-file-media-object* {:file-id (:id file1)
|
|
:is-local false
|
|
:media-id (:id sobject)})]
|
|
|
|
(th/mark-file-deleted* {:id (:id file1)})
|
|
|
|
(let [data {::th/type :duplicate-project
|
|
::rpc/profile-id (:id profile)
|
|
:project-id (:id project)
|
|
:name "project 1 (copy)"}
|
|
out (th/command! data)]
|
|
|
|
;; Check that result is correct
|
|
(t/is (nil? (:error out)))
|
|
|
|
(let [result (:result out)]
|
|
;; Check that they are the same project but different id and name
|
|
(t/is (= "project 1 (copy)" (:name result)))
|
|
(t/is (not= (:id project) (:id result)))
|
|
|
|
;; Check the total number of projects (previously is 2, now is 3)
|
|
(let [rows (th/db-query :project {:team-id (:default-team-id profile)})]
|
|
(t/is (= 3 (count rows))))
|
|
|
|
;; Check that the new project has only the second file
|
|
(let [p1-files (th/db-query :file
|
|
{:project-id (:id project)}
|
|
{:order-by [:name]})
|
|
p2-files (th/db-query :file
|
|
{:project-id (:id result)}
|
|
{:order-by [:name]})]
|
|
(t/is (= (count (rest p1-files))
|
|
(count p2-files)))
|
|
|
|
;; check that the both files are equivalent
|
|
(doseq [[fa fb] (map vector (rest p1-files) p2-files)]
|
|
(t/is (not= (:id fa) (:id fb)))
|
|
(t/is (= (:name fa) (:name fb)))))))))
|
|
|
|
(t/deftest move-file-on-same-team
|
|
(let [profile (th/create-profile* 1 {:is-active true})
|
|
team (th/create-team* 1 {:profile-id (:id profile)})
|
|
|
|
project1 (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
|
|
project2 (th/create-project* 2 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project1)})
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project1)
|
|
:is-shared true})]
|
|
|
|
(th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
|
|
;; Try to move to same project
|
|
(let [data {::th/type :move-files
|
|
::rpc/profile-id (:id profile)
|
|
:project-id (:id project1)
|
|
:ids #{(:id file1)}}
|
|
|
|
out (th/command! data)
|
|
error (:error out)]
|
|
(t/is (th/ex-info? error))
|
|
(t/is (th/ex-of-type? error :validation))
|
|
(t/is (th/ex-of-code? error :cant-move-to-same-project)))
|
|
|
|
;; initially project1 should have 2 files
|
|
(let [rows (th/db-query :file {:project-id (:id project1)})]
|
|
(t/is (= 2 (count rows))))
|
|
|
|
;; initially project2 should be empty
|
|
(let [rows (th/db-query :file {:project-id (:id project2)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; move a file1 to project2 (in the same team)
|
|
(let [data {::th/type :move-files
|
|
::rpc/profile-id (:id profile)
|
|
:project-id (:id project2)
|
|
:ids #{(:id file1)}}
|
|
|
|
out (th/command! data)]
|
|
|
|
(t/is (nil? (:error out)))
|
|
(t/is (nil? (:result out)))
|
|
|
|
;; project1 now should contain 1 file
|
|
(let [rows (th/db-query :file {:project-id (:id project1)})]
|
|
(t/is (= 1 (count rows))))
|
|
|
|
;; project2 now should contain 1 file
|
|
(let [rows (th/db-query :file {:project-id (:id project2)})]
|
|
(t/is (= 1 (count rows))))
|
|
|
|
;; file1 should be still linked to file2
|
|
(let [[item :as rows] (th/db-query :file-library-rel {:file-id (:id file1)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:file-id item) (:id file1)))
|
|
(t/is (= (:library-file-id item) (:id file2))))
|
|
|
|
;; should be no libraries on file2
|
|
(let [rows (th/db-query :file-library-rel {:file-id (:id file2)})]
|
|
(t/is (= 0 (count rows)))))))
|
|
|
|
|
|
;; TODO: move a library to other team
|
|
(t/deftest move-file-to-other-team
|
|
(let [profile (th/create-profile* 1 {:is-active true})
|
|
team (th/create-team* 1 {:profile-id (:id profile)})
|
|
|
|
project1 (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
|
|
project2 (th/create-project* 2 {:team-id (:id team)
|
|
:profile-id (:id profile)})
|
|
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project1)})
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project1)
|
|
:is-shared true})
|
|
file3 (th/create-file* 3 {:profile-id (:id profile)
|
|
:project-id (:id project1)
|
|
:is-shared true})]
|
|
|
|
(th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
|
|
(th/link-file-to-library* {:file-id (:id file2)
|
|
:library-id (:id file3)})
|
|
|
|
;; --- initial data checks
|
|
|
|
;; the project1 should have 3 files
|
|
(let [rows (th/db-query :file {:project-id (:id project1)})]
|
|
(t/is (= 3 (count rows))))
|
|
|
|
;; should be no files on project2
|
|
(let [rows (th/db-query :file {:project-id (:id project2)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; the file1 should be linked to file2
|
|
(let [[item :as rows] (th/db-query :file-library-rel {:file-id (:id file1)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:file-id item) (:id file1)))
|
|
(t/is (= (:library-file-id item) (:id file2))))
|
|
|
|
;; the file2 should be linked to file3
|
|
(let [[item :as rows] (th/db-query :file-library-rel {:file-id (:id file2)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:file-id item) (:id file2)))
|
|
(t/is (= (:library-file-id item) (:id file3))))
|
|
|
|
;; should be no libraries on file3
|
|
(let [rows (th/db-query :file-library-rel {:file-id (:id file3)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; move to other project in other team
|
|
(let [data {::th/type :move-files
|
|
::rpc/profile-id (:id profile)
|
|
:project-id (:id project2)
|
|
:ids #{(:id file1)}}
|
|
out (th/command! data)]
|
|
|
|
(t/is (nil? (:error out)))
|
|
(t/is (nil? (:result out)))
|
|
|
|
;; project1 now should have 2 file
|
|
(let [[item1 item2 :as rows] (th/db-query :file {:project-id (:id project1)}
|
|
{:order-by [:created-at]})]
|
|
;; (clojure.pprint/pprint rows)
|
|
(t/is (= 2 (count rows)))
|
|
(t/is (= (:id item1) (:id file2))))
|
|
|
|
;; project2 now should have 1 file
|
|
(let [[item :as rows] (th/db-query :file {:project-id (:id project2)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:id item) (:id file1))))
|
|
|
|
;; the moved file1 should not have any link to libraries
|
|
(let [rows (th/db-query :file-library-rel {:file-id (:id file1)})]
|
|
(t/is (zero? (count rows))))
|
|
|
|
;; the file2 should still be linked to file3
|
|
(let [[item :as rows] (th/db-query :file-library-rel {:file-id (:id file2)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:file-id item) (:id file2)))
|
|
(t/is (= (:library-file-id item) (:id file3)))))))
|
|
|
|
|
|
(t/deftest move-library-to-other-team
|
|
(let [profile (th/create-profile* 1 {:is-active true})
|
|
team (th/create-team* 1 {:profile-id (:id profile)})
|
|
|
|
project1 (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
|
|
project2 (th/create-project* 2 {:team-id (:id team)
|
|
:profile-id (:id profile)})
|
|
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project1)})
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project1)
|
|
:is-shared true})]
|
|
|
|
(th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
|
|
;; --- initial data checks
|
|
|
|
;; the project1 should have 2 files
|
|
(let [rows (th/db-query :file {:project-id (:id project1)})]
|
|
(t/is (= 2 (count rows))))
|
|
|
|
;; should be no files on project2
|
|
(let [rows (th/db-query :file {:project-id (:id project2)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; the file1 should be linked to file2
|
|
(let [[item :as rows] (th/db-query :file-library-rel {:file-id (:id file1)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:file-id item) (:id file1)))
|
|
(t/is (= (:library-file-id item) (:id file2))))
|
|
|
|
;; should be no libraries on file2
|
|
(let [rows (th/db-query :file-library-rel {:file-id (:id file2)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; move the library to other project
|
|
(let [data {::th/type :move-files
|
|
::rpc/profile-id (:id profile)
|
|
:project-id (:id project2)
|
|
:ids #{(:id file2)}}
|
|
out (th/command! data)]
|
|
|
|
(t/is (nil? (:error out)))
|
|
(t/is (nil? (:result out)))
|
|
|
|
;; project1 now should have 1 file
|
|
(let [[item :as rows] (th/db-query :file {:project-id (:id project1)}
|
|
{:order-by [:created-at]})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:id item) (:id file1))))
|
|
|
|
;; project2 now should have 1 file
|
|
(let [[item :as rows] (th/db-query :file {:project-id (:id project2)})]
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:id item) (:id file2))))
|
|
|
|
;; the file1 should not have any link to libraries
|
|
(let [rows (th/db-query :file-library-rel {:file-id (:id file1)})]
|
|
(t/is (zero? (count rows))))
|
|
|
|
;; the file2 should not have any link to libraries
|
|
(let [rows (th/db-query :file-library-rel {:file-id (:id file2)})]
|
|
(t/is (zero? (count rows)))))))
|
|
|
|
(t/deftest move-project
|
|
(let [profile (th/create-profile* 1 {:is-active true})
|
|
team (th/create-team* 1 {:profile-id (:id profile)})
|
|
|
|
project1 (th/create-project* 1 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
|
|
project2 (th/create-project* 2 {:team-id (:default-team-id profile)
|
|
:profile-id (:id profile)})
|
|
|
|
file1 (th/create-file* 1 {:profile-id (:id profile)
|
|
:project-id (:id project1)})
|
|
|
|
file2 (th/create-file* 2 {:profile-id (:id profile)
|
|
:project-id (:id project1)
|
|
:is-shared true})
|
|
|
|
file3 (th/create-file* 3 {:profile-id (:id profile)
|
|
:project-id (:id project2)
|
|
:is-shared true})]
|
|
|
|
(th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file2)})
|
|
|
|
(th/link-file-to-library* {:file-id (:id file1)
|
|
:library-id (:id file3)})
|
|
|
|
;; --- initial data checks
|
|
|
|
;; the project1 should have 2 files
|
|
(let [rows (th/db-query :file {:project-id (:id project1)})]
|
|
(t/is (= 2 (count rows))))
|
|
|
|
;; the project2 should have 1 file
|
|
(let [rows (th/db-query :file {:project-id (:id project2)})]
|
|
(t/is (= 1 (count rows))))
|
|
|
|
;; the file1 should be linked to file2 and file3
|
|
(let [[item1 item2 :as rows] (th/db-query :file-library-rel
|
|
{:file-id (:id file1)}
|
|
{:order-by [:created-at]})]
|
|
(t/is (= 2 (count rows)))
|
|
(t/is (= (:file-id item1) (:id file1)))
|
|
(t/is (= (:library-file-id item1) (:id file2)))
|
|
(t/is (= (:file-id item2) (:id file1)))
|
|
(t/is (= (:library-file-id item2) (:id file3))))
|
|
|
|
;; the file2 should not be linked to any file
|
|
(let [[rows] (th/db-query :file-library-rel {:file-id (:id file2)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; the file3 should not be linked to any file
|
|
(let [[rows] (th/db-query :file-library-rel {:file-id (:id file3)})]
|
|
(t/is (= 0 (count rows))))
|
|
|
|
;; move project1 to other team
|
|
(let [data {::th/type :move-project
|
|
::rpc/profile-id (:id profile)
|
|
:project-id (:id project1)
|
|
:team-id (:id team)}
|
|
out (th/command! data)]
|
|
|
|
(t/is (nil? (:error out)))
|
|
(t/is (nil? (:result out)))
|
|
|
|
;; project1 now should still have 2 files
|
|
(let [[item1 item2 :as rows] (th/db-query :file
|
|
{:project-id (:id project1)}
|
|
{:order-by [:created-at]})]
|
|
;; (clojure.pprint/pprint rows)
|
|
(t/is (= 2 (count rows)))
|
|
(t/is (= (:id item1) (:id file1)))
|
|
(t/is (= (:id item2) (:id file2))))
|
|
|
|
;; project2 now should still have 1 file
|
|
(let [[item :as rows] (th/db-query :file {:project-id (:id project2)})]
|
|
;; (pp/pprint rows)
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:id item) (:id file3))))
|
|
|
|
;; the file1 should be linked to file2 but not file3
|
|
(let [[item1 :as rows] (th/db-query :file-library-rel
|
|
{:file-id (:id file1)}
|
|
{:order-by [:created-at]})]
|
|
|
|
(t/is (= 1 (count rows)))
|
|
(t/is (= (:file-id item1) (:id file1)))
|
|
(t/is (= (:library-file-id item1) (:id file2)))))))
|
|
|
|
(t/deftest clone-template
|
|
(let [prof (th/create-profile* 1 {:is-active true})
|
|
data {::th/type :clone-template
|
|
::rpc/profile-id (:id prof)
|
|
:project-id (:default-project-id prof)
|
|
:template-id "test"}
|
|
|
|
out (th/command! data)]
|
|
;; (th/print-result! out)
|
|
|
|
(t/is (nil? (:error out)))
|
|
(let [result (:result out)]
|
|
(t/is (fn? result))
|
|
|
|
(let [events (th/consume-sse result)]
|
|
(t/is (= 5 (count events)))
|
|
(t/is (= :end (first (last events))))))))
|
|
|
|
(t/deftest get-list-of-buitin-templates
|
|
(let [prof (th/create-profile* 1 {:is-active true})
|
|
data {::th/type :get-builtin-templates
|
|
::rpc/profile-id (:id prof)}
|
|
out (th/command! data)]
|
|
;; (th/print-result! out)
|
|
(t/is (nil? (:error out)))
|
|
(let [result (:result out)]
|
|
(t/is (vector? result))
|
|
(t/is (= 1 (count result)))
|
|
(t/is (= "test" (:id (first result)))))))
|