Daniel Gasienica
106ce21c49
Remove redundant log message
7 years ago
Daniel Gasienica
fcd30cd919
Close database after migration
...
This is not 100% reliable as database connections are closed in a separate
thread according to the documentation:
- https://developer.mozilla.org/en-US/docs/Web/API/IDBDatabase/close
- https://stackoverflow.com/a/18639298
- 80c7a06d5c/backbone-indexeddb.js (L558-L565)
7 years ago
Daniel Gasienica
c765422fa1
Extract `deferredToPromise`
7 years ago
Daniel Gasienica
e2f1339ab9
Explicitly run post-attachment migrations
7 years ago
Daniel Gasienica
d7c8d33edb
Extract `runMigrations`
7 years ago
Daniel Gasienica
d16178638e
Split database migrations into pre- and post-attachment migration
...
- Run light-weight migrations before attachment migration.
- Run regular migrations after attachments have been moved to disk.
7 years ago
Daniel Gasienica
90de9d85a3
Remove type annotation
7 years ago
Daniel Gasienica
4c10fcfa17
Reduce threshold until optimization appears to 1s
7 years ago
Daniel Gasienica
add19aa732
Add initialization view
7 years ago
Daniel Gasienica
9b112489cd
Upgrade 2 messages every 30 seconds
...
This results in 4 messages per minute or 240 messages per hour.
7 years ago
Daniel Gasienica
7c2fde4433
Add `Signal.Workflow` namespace
7 years ago
Daniel Gasienica
4a7cc22de3
🎨 Use `window.requestIdleCallback`
7 years ago
Daniel Gasienica
4651cbc2eb
Improve ``Message.upgradeSchema` preconditions
7 years ago
Daniel Gasienica
ca28f3030b
Add `MessageMigration` module
7 years ago
Daniel Gasienica
8e762797c0
Remove attachment validation
...
Turns out `fileName` is optional and maybe even `contentType`. We should revisit
this at a later point in time.
7 years ago
Daniel Gasienica
09ee2d4ea2
Switch to using `requestIdleCallback`
...
Example:
https://developer.mozilla.org/en-US/docs/Web/API/Background_Tasks_API#Example
7 years ago
Daniel Gasienica
d13668544d
Rename `IdleListener` to `IdleDetector`
7 years ago
Daniel Gasienica
3140e4d66d
Implement basic `IdleListener`
7 years ago
Daniel Gasienica
867f73b80a
Use double quotes for identifiers in error messages
7 years ago
Daniel Gasienica
70cdd2b350
Add `stringToArrayBuffer` utility
...
This way we can avoid an extra dependency.
7 years ago
Daniel Gasienica
2ad0fd7db6
Use Lodash `omit` instead of `delete`
7 years ago
Daniel Gasienica
279b3f81c7
Add `Attachment.deleteData`
7 years ago
Daniel Gasienica
9a540d6d18
Load attachment data before sending message
7 years ago
Daniel Gasienica
6355c54114
Return relative path from `writeAttachmentData`
...
This will make our app more robust to changes in location on the file system.
7 years ago
Daniel Gasienica
2cd3d5ac16
Add `Message` schema version 3
7 years ago
Daniel Gasienica
aa82a2a5fb
Add `context` to `Message.upgradeSchema`
...
Allows us to pass in Electron/Node.js specific functions. This allows better
unit testing in Mocha where we don’t have access to Electron APIs.
7 years ago
Daniel Gasienica
ebe2a769c9
Add `Attachment.migrateDataToFileSystem`
7 years ago
Scott Nonnenberg
cea42bde7d
Encryption support for backup and restore
...
Also moved to the _ prefix in backup.js for all private methods exported
for testing.
7 years ago
Scott Nonnenberg
6d8f4b7b6e
Backup: zipped messages.json, flat attachments dir
...
Backup creates, in a target directory:
- An attachments folder, with all attachments, each named for their
parent message's id - a GUID. If there is more than one attachment
in a given message, each attachment beyond the first will end with
'-N', zero-indexed.
- A file named messages.zip. It contains exactly what went to disk in
the original export code, but zipped up.
Export is now only 'light,' and in this new messages.zip format.
Import supports both the new format and the old format. If the target
directory has a messages.zip file, we'll treat it as the new format.
Next up: Encrypting attachments and the messages.zip!
7 years ago
Scott Nonnenberg
153a22f46b
Exclude unnecessary data in export: profiles, replayable errors
7 years ago
Scott Nonnenberg
c0c758d459
Backup: All exports are now 'light' exports
7 years ago
Scott Nonnenberg
e583434366
Refactor: Move Backup under window.Signal
7 years ago
Daniel Gasienica
c88381efe3
Use `async` / `await` to improve readability
7 years ago
Daniel Gasienica
2642844c27
Rewrite migration 17 without `idb`
...
We ran into issues when doing async operations inside of an IndexedDB
`onupgradeneeded` handler. The errors were ‘The transaction is not active’ or
‘Transaction has finished’. The following documentation confirmed that
transactions are committed/terminated when control returns to the event loop:
Spec
- https://www.w3.org/TR/IndexedDB/#transaction-lifetime-concept
- https://www.w3.org/TR/IndexedDB/#upgrade-transaction-construct
Stack Overflow
- https://stackoverflow.com/a/11059085
- https://stackoverflow.com/a/27338944
Since the initial database migration is so critical, I decided to avoid `idb`
with promise support for IndexedDB for now, but will reconsider using it for
other tasks in the future to improve readability of IndexedDB code.
7 years ago
Daniel Gasienica
a619d48fac
Update schema version history
7 years ago
Daniel Gasienica
0e20e8e2ea
Use `Errors.toLogFormat`
7 years ago
Daniel Gasienica
a5edbf8328
Initialize schema as first step in `upgradeSchema`
7 years ago
Daniel Gasienica
5d927b73e6
Use `while` loop for IDB cursor iteration
...
Previously, I messily combined promises and callbacks because I thought we
were affected by the microtask issue:
https://github.com/gasi/idb#iteratecursor--iteratekeycursor
ESLint’s `more/no-then` encouraged me to revisit this and it works as expected.
7 years ago
Daniel Gasienica
182e6ffe10
Add version 17 migration
7 years ago
Daniel Gasienica
752c8f97e6
🎨 Format ternaries
7 years ago
Daniel Gasienica
8dfaa5619f
Prefix private functions with underscore
7 years ago
Daniel Gasienica
ed336d31d7
Move schema versioning from `Attachment` to `Message`
7 years ago
Daniel Gasienica
b9e9f5e19a
🎨 `withInheritedSchemaVersion` to `inheritSchemaVersion`
7 years ago
Daniel Gasienica
df693ade7c
Allow `Attachment.fileName` to be `null`
7 years ago
Daniel Gasienica
c27746b79e
Add `Message.withInheritedSchemaVersion`
7 years ago
Daniel Gasienica
e9e46464c2
Add `SchemaVersion` type
7 years ago
Daniel Gasienica
add4b11df3
Skip invalid attachments and make function sync
7 years ago
Daniel Gasienica
3dfc823716
Add `Attachment.removeSchemaVersion`
7 years ago
Scott Nonnenberg
26c273618a
Refactor: db tasks to database.js, log delete to modules/logs.js
7 years ago
Daniel Gasienica
43b47fd349
Avoid `ensure-error` for privacy reasons
...
Example:
```
> node
> const nonError = {foo: 'i-am-private'};
undefined
// before
> util.inspect(nonError);
'{ foo: \'i-am-private\' }'
// after
> nonError.toString()
'[object Object]'
>
```
7 years ago