192 Commits

Author SHA1 Message Date
Andrey Antukh
b05421755f 🐛 Fix srepl report query 2024-02-22 14:55:35 +01:00
Alejandro Alonso
5590210088 🐛 Add fix files function to removed :shapes-group from :touched 2024-02-21 16:21:46 +01:00
Andrey Antukh
b718a282e0 ♻️ Add minor refactor to file migrations
Relevant changes:

- Add the ability to create migration in both directions, defaulting
  to identity if not provided
- Move the version attribute to file table column for to make it more
  accessible (previously it was on data blob)
- Reduce db update operations on file-update rpc method
2024-02-19 09:20:47 +01:00
Andrey Antukh
63e74545ab 📎 Add get-raw-file srepl helper 2024-02-14 17:38:53 +01:00
Andrey Antukh
bc3d268f57 Add minor improvements to srepl helpers 2024-02-13 19:09:54 +01:00
Andrey Antukh
1cb6f43339 📎 Add srepl fix function for disable fdata features 2024-02-13 17:54:11 +01:00
Andrey Antukh
e8a1c58c5d 🐛 Fix incorrect change detection on srepl helper process-file 2024-02-13 17:54:11 +01:00
Andrey Antukh
f4ac607958 ♻️ Refactor srepl helpers 2024-02-12 10:21:47 +01:00
Andrey Antukh
f9af2a16b9 Add the ability to create a file snapshot on repair 2024-02-09 12:01:09 +01:00
Andrey Antukh
c07dbc9843 📎 Move repair and validate srepl helpers to srepl.main 2024-02-09 12:01:09 +01:00
Andrey Antukh
6d35cb2eb4 Improve snapshot related internal API
This commit also adds the ability to take snapshot of all files
of the team in a single run/transaction.
2024-02-09 12:01:09 +01:00
Andrey Antukh
a5fc42cafa Normalize ids parsing on srepl helpers 2024-02-09 12:01:09 +01:00
Andrey Antukh
d2626ead0b Add better email cleaning mechanism
This commit separates the email cleaning mechanism to a separated
function, and enables a proper cleaning of `mailto:` prefix, usually
found on invitations because users just copy and paste from external
source.
2024-02-07 09:14:07 +01:00
Andrey Antukh
040b336ef9 Add helper for restoring team after migration to comp-v2 2024-02-06 19:20:25 +01:00
Andrey Antukh
2331647ec6 🐛 Add missing team-profile rels cloning on duplicate-team srepl helper 2024-02-06 19:18:22 +01:00
Andrey Antukh
267045e113 Improve migration scripts 2024-02-06 17:22:20 +01:00
Andrey Antukh
3a401f69fd Simplify srepl helper for shape deletion 2024-02-02 10:54:34 +01:00
Andrey Antukh
d4c91ae44b 💄 Print file name on process-file! helper progress report 2024-02-02 10:54:33 +01:00
Andrey Antukh
5e4e706033 Use proper executor for cache on comp-v2 migration 2024-02-02 10:54:33 +01:00
Andrey Antukh
893a8992c3 Add progress reporting on process-files! srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
f97931647c Add helper for mark for deletion invalid files 2024-02-02 10:54:33 +01:00
Andrey Antukh
13ca5d1f1a Add minor improvements to process-files! srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
7c0a63c7da Add minor improvements to comp-v2 migration srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
4e9b92b857 📎 Add helper for check not referenced media 2024-01-30 19:30:05 +01:00
Andrey Antukh
cdf312fdd9 Add better progress reporting
For components migration and for binfile import process
2024-01-30 16:27:16 +01:00
Andrey Antukh
7f60946204 ♻️ Refactor exportation and duplicate mechanism
Previously the file processing was implemented 3 times using similar
approaches bug each own with its own bugs. This PR unifies the
loging to a single implementation used by the 3 operations.
2024-01-30 16:27:16 +01:00
Andrey Antukh
e6766bac8f Set correct order of filtering teams on migration function 2024-01-25 16:03:31 +01:00
Andrey Antukh
1b3e68f430 Improve partitioning and graphics error skiping mechanism
On the migration functions
2024-01-25 16:03:31 +01:00
Andrey Antukh
3f97b3a112 🐛 Fix minor issues on migration code 2024-01-25 16:03:30 +01:00
Andrey Antukh
4ab4ad96f0 🐛 Resolve objects-map on srepl/get-file helpers 2024-01-25 16:03:30 +01:00
Andrey Antukh
0d33779c95 Add support for reporting and partitions on comp-v2 migration code 2024-01-25 16:03:30 +01:00
Andrey Antukh
ec1bcada86 🐛 Fix recent colors on components migration 2024-01-25 16:03:29 +01:00
Andrey Antukh
0a5e15b916 ♻️ Simplify components-v2 migration functions impl 2024-01-25 16:03:29 +01:00
Andrey Antukh
944d167bbb Simplify SVGO module API 2024-01-25 15:59:45 +01:00
Andrey Antukh
d4d3f9ca81 🎉 Add the ability to export import entire team
For now only available as srepl helper
2024-01-16 17:17:30 +01:00
Andrey Antukh
b63a8d34b5 🐛 Fix debug reset file version method 2024-01-10 14:36:30 +01:00
Andrey Antukh
0b29aaecc4 💄 Format backend code 2024-01-08 09:32:50 +01:00
Andrey Antukh
2698944ec7 Add proper file iteration on srepl helpers 2024-01-05 17:59:39 +01:00
Andrey Antukh
4899b3af6e 🐛 Fix incorrect pointer deref on validating file on update operation 2024-01-04 16:31:57 +01:00
Andrey Antukh
41287d8fc5 Improve migration script performance and api usability 2024-01-04 14:40:22 +01:00
Andrey Antukh
746d898245 Improve the db api efficiency
Mainly setup proper defaults and reduce unnecesary allocations
on every db api call.
2024-01-04 12:41:16 +01:00
Andrey Antukh
0ebf9564b2 Add internal helper for team duplication 2024-01-02 12:01:07 +01:00
Andrey Antukh
2dbe7bca07 Add general improvements to file validation and repair api 2023-12-14 10:35:24 +01:00
Andrey Antukh
417366d998 Reorganize fdata/pointer-map feature helpers
Mainly move all pointer-map related helpers from app.rpc.commands.files
to the the app.features.fdata namespace and normalizes codestile around
feature handling on all affected code.

This commit also comes with several features related bugifxes on the
components-v2 migration code:

- properly migrate legacy feature names on apply components-v2 migration
- start using new fdata feature related functions
- prevent generation of a ephimeral pointer on each graphic migration
  operation; on large files this caused a very noticiable overhead of
  creating a big number of completly unused pointer maps
- do persistence after validation and not before
2023-12-13 14:20:07 +01:00
Andrey Antukh
f3e9efa6fe ♻️ Refactor srepl helpers 2023-12-13 11:56:20 +01:00
Alejandro Alonso
fd115ae7a1 🎉 Add validation and repair to repl helpers 2023-12-12 14:11:28 +01:00
Andrey Antukh
87615ce221 💄 Fix format issues on backend module 2023-11-29 12:55:58 +01:00
Andrey Antukh
ac3d7f00d5 Make file schema validation configurable using flags 2023-11-20 19:42:46 +01:00
Andrey Antukh
ec8b68721b Improve schema validation handling
And properly honor the file-validation flag
2023-11-20 16:57:05 +01:00
Andrey Antukh
08166bcebf Add initial impl for migrate-components-v2 manage.py command 2023-11-20 11:21:13 +01:00