180 Commits

Author SHA1 Message Date
Andrey Antukh
d2626ead0b Add better email cleaning mechanism
This commit separates the email cleaning mechanism to a separated
function, and enables a proper cleaning of `mailto:` prefix, usually
found on invitations because users just copy and paste from external
source.
2024-02-07 09:14:07 +01:00
Andrey Antukh
040b336ef9 Add helper for restoring team after migration to comp-v2 2024-02-06 19:20:25 +01:00
Andrey Antukh
2331647ec6 🐛 Add missing team-profile rels cloning on duplicate-team srepl helper 2024-02-06 19:18:22 +01:00
Andrey Antukh
267045e113 Improve migration scripts 2024-02-06 17:22:20 +01:00
Andrey Antukh
3a401f69fd Simplify srepl helper for shape deletion 2024-02-02 10:54:34 +01:00
Andrey Antukh
d4c91ae44b 💄 Print file name on process-file! helper progress report 2024-02-02 10:54:33 +01:00
Andrey Antukh
5e4e706033 Use proper executor for cache on comp-v2 migration 2024-02-02 10:54:33 +01:00
Andrey Antukh
893a8992c3 Add progress reporting on process-files! srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
f97931647c Add helper for mark for deletion invalid files 2024-02-02 10:54:33 +01:00
Andrey Antukh
13ca5d1f1a Add minor improvements to process-files! srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
7c0a63c7da Add minor improvements to comp-v2 migration srepl helper 2024-02-02 10:54:33 +01:00
Andrey Antukh
4e9b92b857 📎 Add helper for check not referenced media 2024-01-30 19:30:05 +01:00
Andrey Antukh
cdf312fdd9 Add better progress reporting
For components migration and for binfile import process
2024-01-30 16:27:16 +01:00
Andrey Antukh
7f60946204 ♻️ Refactor exportation and duplicate mechanism
Previously the file processing was implemented 3 times using similar
approaches bug each own with its own bugs. This PR unifies the
loging to a single implementation used by the 3 operations.
2024-01-30 16:27:16 +01:00
Andrey Antukh
e6766bac8f Set correct order of filtering teams on migration function 2024-01-25 16:03:31 +01:00
Andrey Antukh
1b3e68f430 Improve partitioning and graphics error skiping mechanism
On the migration functions
2024-01-25 16:03:31 +01:00
Andrey Antukh
3f97b3a112 🐛 Fix minor issues on migration code 2024-01-25 16:03:30 +01:00
Andrey Antukh
4ab4ad96f0 🐛 Resolve objects-map on srepl/get-file helpers 2024-01-25 16:03:30 +01:00
Andrey Antukh
0d33779c95 Add support for reporting and partitions on comp-v2 migration code 2024-01-25 16:03:30 +01:00
Andrey Antukh
ec1bcada86 🐛 Fix recent colors on components migration 2024-01-25 16:03:29 +01:00
Andrey Antukh
0a5e15b916 ♻️ Simplify components-v2 migration functions impl 2024-01-25 16:03:29 +01:00
Andrey Antukh
944d167bbb Simplify SVGO module API 2024-01-25 15:59:45 +01:00
Andrey Antukh
d4d3f9ca81 🎉 Add the ability to export import entire team
For now only available as srepl helper
2024-01-16 17:17:30 +01:00
Andrey Antukh
b63a8d34b5 🐛 Fix debug reset file version method 2024-01-10 14:36:30 +01:00
Andrey Antukh
0b29aaecc4 💄 Format backend code 2024-01-08 09:32:50 +01:00
Andrey Antukh
2698944ec7 Add proper file iteration on srepl helpers 2024-01-05 17:59:39 +01:00
Andrey Antukh
4899b3af6e 🐛 Fix incorrect pointer deref on validating file on update operation 2024-01-04 16:31:57 +01:00
Andrey Antukh
41287d8fc5 Improve migration script performance and api usability 2024-01-04 14:40:22 +01:00
Andrey Antukh
746d898245 Improve the db api efficiency
Mainly setup proper defaults and reduce unnecesary allocations
on every db api call.
2024-01-04 12:41:16 +01:00
Andrey Antukh
0ebf9564b2 Add internal helper for team duplication 2024-01-02 12:01:07 +01:00
Andrey Antukh
2dbe7bca07 Add general improvements to file validation and repair api 2023-12-14 10:35:24 +01:00
Andrey Antukh
417366d998 Reorganize fdata/pointer-map feature helpers
Mainly move all pointer-map related helpers from app.rpc.commands.files
to the the app.features.fdata namespace and normalizes codestile around
feature handling on all affected code.

This commit also comes with several features related bugifxes on the
components-v2 migration code:

- properly migrate legacy feature names on apply components-v2 migration
- start using new fdata feature related functions
- prevent generation of a ephimeral pointer on each graphic migration
  operation; on large files this caused a very noticiable overhead of
  creating a big number of completly unused pointer maps
- do persistence after validation and not before
2023-12-13 14:20:07 +01:00
Andrey Antukh
f3e9efa6fe ♻️ Refactor srepl helpers 2023-12-13 11:56:20 +01:00
Alejandro Alonso
fd115ae7a1 🎉 Add validation and repair to repl helpers 2023-12-12 14:11:28 +01:00
Andrey Antukh
87615ce221 💄 Fix format issues on backend module 2023-11-29 12:55:58 +01:00
Andrey Antukh
ac3d7f00d5 Make file schema validation configurable using flags 2023-11-20 19:42:46 +01:00
Andrey Antukh
ec8b68721b Improve schema validation handling
And properly honor the file-validation flag
2023-11-20 16:57:05 +01:00
Andrey Antukh
08166bcebf Add initial impl for migrate-components-v2 manage.py command 2023-11-20 11:21:13 +01:00
Andrey Antukh
52fbc678f3 ♻️ Move app.common.pages to app.common.files 2023-11-16 11:07:36 +01:00
Andrey Antukh
1457b7cf38 Add performance and reporting improvements to migration script 2023-11-15 14:01:34 +01:00
Andrés Moya
08f12f4f6c 🐛 Handle correctly pointers when loading libraries 2023-11-15 10:13:24 +01:00
Andrés Moya
451d6c1d7b Add optional validation when migrating files to components-v2 2023-11-14 14:15:29 +01:00
Andrés Moya
3dfd54d8e2 Allow to analyze files with a function that needs libs 2023-11-14 14:15:29 +01:00
Andrey Antukh
99f39c9777 Add improved REPL support 2023-11-13 18:33:28 +01:00
Andrey Antukh
ec51e0c0d7 Add max-time constraint for migration 2023-11-08 13:18:50 +01:00
Andrey Antukh
b0418ff5f2 Add file snapshoting on migration 2023-11-08 10:45:08 +01:00
Andrey Antukh
bb6fd4107b 🎉 Add migration scripts 2023-11-07 12:48:31 +01:00
Andrey Antukh
6f93b41920 🎉 Add features assignation for teams 2023-11-07 12:48:31 +01:00
Andrés Moya
1f04304210 Add protection to fix script 2023-09-29 13:29:21 +02:00
Andrés Moya
de8758c4ca 🐛 Fix added children detection in fix-touched script 2023-09-22 11:25:48 +02:00