156 Commits

Author SHA1 Message Date
Andrey Antukh
574c8d1789 Move library-absorb operation to async task
And make it not mandatory in case of failure
2024-05-27 11:19:15 +02:00
Andrey Antukh
761bbb7334 Add srepl helpers for delete/restore teams, projects, and files 2024-05-27 11:17:00 +02:00
Alejandro
5ab4ed9a05
Merge pull request #4621 from penpot/niwinz-objects-gc-locking
 Reduce locking on objects-gc task
2024-05-24 09:04:11 +02:00
Andrey Antukh
584a0fdba1 Reduce locking on objects-gc task
The main issue was the long running gc operation that
affects storage objects with deduplication. The long running
transacion ends locking some storage object rows which collaterally
made operations like import-binfile become blocked indefinitelly
because of the same rows (because of deduplication).

The solution used in this commit is split operations on small
chunks so we no longer use long running transactions that holds
too many locks. With this approach we will make a window to work
concurrently all operarate the distinct operations that requires
locks on the same rows.
2024-05-23 16:35:54 +02:00
Andrey Antukh
29ef9f752a 🐛 Fix incorrect password encoding on create-profile manage command 2024-05-23 14:42:28 +02:00
Andrey Antukh
ce790d83fd Improve internal registration flow 2024-04-18 09:52:24 +02:00
Andrey Antukh
c55ceb4bca Add automatic v2 migration process on startup 2024-04-10 15:31:49 +02:00
Andrey Antukh
5924f3bc41 Simplify v2 migration helpers on srepl ns 2024-04-10 15:31:49 +02:00
Andrey Antukh
e01f8d6fdf 📎 Update migration scripts 2024-04-07 14:07:40 +02:00
Andrey Antukh
fed9346ec6 Improve partitioning mechanism on compv2 migration 2024-04-07 14:07:40 +02:00
Andrey Antukh
a6c9ced5b3 🐛 Fix minor issue on internal srepl helpers 2024-03-22 12:59:16 +01:00
Alejandro Alonso
b9743891bb 🐛 Fix is-main-of? calculation for v2 components 2024-03-21 15:49:08 +01:00
Andrés Moya
2247f0ecac ♻️ Add a tool to generate swap-slots 2024-03-13 17:01:43 +01:00
Andrey Antukh
b30d525400 🐛 Fix opts passing on process-file! srepl helper 2024-03-11 11:18:46 +01:00
Andrey Antukh
b05421755f 🐛 Fix srepl report query 2024-02-22 14:55:35 +01:00
Alejandro Alonso
5590210088 🐛 Add fix files function to removed :shapes-group from :touched 2024-02-21 16:21:46 +01:00
Andrey Antukh
b718a282e0 ♻️ Add minor refactor to file migrations
Relevant changes:

- Add the ability to create migration in both directions, defaulting
  to identity if not provided
- Move the version attribute to file table column for to make it more
  accessible (previously it was on data blob)
- Reduce db update operations on file-update rpc method
2024-02-19 09:20:47 +01:00
Andrey Antukh
63e74545ab 📎 Add get-raw-file srepl helper 2024-02-14 17:38:53 +01:00
Andrey Antukh
bc3d268f57 Add minor improvements to srepl helpers 2024-02-13 19:09:54 +01:00
Andrey Antukh
1cb6f43339 📎 Add srepl fix function for disable fdata features 2024-02-13 17:54:11 +01:00
Andrey Antukh
e8a1c58c5d 🐛 Fix incorrect change detection on srepl helper process-file 2024-02-13 17:54:11 +01:00
Andrey Antukh
f4ac607958 ♻️ Refactor srepl helpers 2024-02-12 10:21:47 +01:00
Andrey Antukh
f9af2a16b9 Add the ability to create a file snapshot on repair 2024-02-09 12:01:09 +01:00
Andrey Antukh
c07dbc9843 📎 Move repair and validate srepl helpers to srepl.main 2024-02-09 12:01:09 +01:00
Andrey Antukh
6d35cb2eb4 Improve snapshot related internal API
This commit also adds the ability to take snapshot of all files
of the team in a single run/transaction.
2024-02-09 12:01:09 +01:00
Andrey Antukh
a5fc42cafa Normalize ids parsing on srepl helpers 2024-02-09 12:01:09 +01:00
Andrey Antukh
d2626ead0b Add better email cleaning mechanism
This commit separates the email cleaning mechanism to a separated
function, and enables a proper cleaning of `mailto:` prefix, usually
found on invitations because users just copy and paste from external
source.
2024-02-07 09:14:07 +01:00
Andrey Antukh
040b336ef9 Add helper for restoring team after migration to comp-v2 2024-02-06 19:20:25 +01:00
Andrey Antukh
2331647ec6 🐛 Add missing team-profile rels cloning on duplicate-team srepl helper 2024-02-06 19:18:22 +01:00
Andrey Antukh
267045e113 Improve migration scripts 2024-02-06 17:22:20 +01:00
Andrey Antukh
3a401f69fd Simplify srepl helper for shape deletion 2024-02-02 10:54:34 +01:00
Andrey Antukh
d4c91ae44b 💄 Print file name on process-file! helper progress report 2024-02-02 10:54:33 +01:00
Andrey Antukh
5e4e706033 Use proper executor for cache on comp-v2 migration 2024-02-02 10:54:33 +01:00
Andrey Antukh
893a8992c3 Add progress reporting on process-files! srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
f97931647c Add helper for mark for deletion invalid files 2024-02-02 10:54:33 +01:00
Andrey Antukh
13ca5d1f1a Add minor improvements to process-files! srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
7c0a63c7da Add minor improvements to comp-v2 migration srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
4e9b92b857 📎 Add helper for check not referenced media 2024-01-30 19:30:05 +01:00
Andrey Antukh
cdf312fdd9 Add better progress reporting
For components migration and for binfile import process
2024-01-30 16:27:16 +01:00
Andrey Antukh
7f60946204 ♻️ Refactor exportation and duplicate mechanism
Previously the file processing was implemented 3 times using similar
approaches bug each own with its own bugs. This PR unifies the
loging to a single implementation used by the 3 operations.
2024-01-30 16:27:16 +01:00
Andrey Antukh
e6766bac8f Set correct order of filtering teams on migration function 2024-01-25 16:03:31 +01:00
Andrey Antukh
1b3e68f430 Improve partitioning and graphics error skiping mechanism
On the migration functions
2024-01-25 16:03:31 +01:00
Andrey Antukh
3f97b3a112 🐛 Fix minor issues on migration code 2024-01-25 16:03:30 +01:00
Andrey Antukh
4ab4ad96f0 🐛 Resolve objects-map on srepl/get-file helpers 2024-01-25 16:03:30 +01:00
Andrey Antukh
0d33779c95 Add support for reporting and partitions on comp-v2 migration code 2024-01-25 16:03:30 +01:00
Andrey Antukh
ec1bcada86 🐛 Fix recent colors on components migration 2024-01-25 16:03:29 +01:00
Andrey Antukh
0a5e15b916 ♻️ Simplify components-v2 migration functions impl 2024-01-25 16:03:29 +01:00
Andrey Antukh
944d167bbb Simplify SVGO module API 2024-01-25 15:59:45 +01:00
Andrey Antukh
d4d3f9ca81 🎉 Add the ability to export import entire team
For now only available as srepl helper
2024-01-16 17:17:30 +01:00
Andrey Antukh
b63a8d34b5 🐛 Fix debug reset file version method 2024-01-10 14:36:30 +01:00