mirror of
https://github.com/maybe-finance/maybe.git
synced 2025-07-24 15:49:39 +02:00
03a146222d
Breaks our Plaid sync process out into more manageable classes. Notably, this moves the sync process to a distinct, 2-step flow: 1. Import stage - we first make API calls and import Plaid data to "mirror" tables 2. Processing stage - read the raw data, apply business rules, build internal domain models and sync balances This provides several benefits: - Plaid syncs can now be "replayed" without fetching API data again - Mirror tables provide better audit and debugging capabilities - Eliminates the "all or nothing" sync behavior that is currently in place, which is brittle
24 lines
1.1 KiB
Ruby
24 lines
1.1 KiB
Ruby
class AddRawPayloadsToPlaidAccounts < ActiveRecord::Migration[7.2]
|
|
def change
|
|
add_column :plaid_items, :raw_payload, :jsonb, default: {}
|
|
add_column :plaid_items, :raw_institution_payload, :jsonb, default: {}
|
|
|
|
change_column_null :plaid_items, :plaid_id, false
|
|
add_index :plaid_items, :plaid_id, unique: true
|
|
|
|
add_column :plaid_accounts, :raw_payload, :jsonb, default: {}
|
|
add_column :plaid_accounts, :raw_transactions_payload, :jsonb, default: {}
|
|
add_column :plaid_accounts, :raw_investments_payload, :jsonb, default: {}
|
|
add_column :plaid_accounts, :raw_liabilities_payload, :jsonb, default: {}
|
|
|
|
change_column_null :plaid_accounts, :plaid_id, false
|
|
change_column_null :plaid_accounts, :plaid_type, false
|
|
change_column_null :plaid_accounts, :currency, false
|
|
change_column_null :plaid_accounts, :name, false
|
|
add_index :plaid_accounts, :plaid_id, unique: true
|
|
|
|
# No longer need to store on transaction model because it is stored in raw_transactions_payload
|
|
remove_column :transactions, :plaid_category, :string
|
|
remove_column :transactions, :plaid_category_detailed, :string
|
|
end
|
|
end
|