Transaction rules engine V1 (#1900)

* Domain model sketch

* Scaffold out rules domain

* Migrations

* Remove existing data enrichment for clean slate

* Sketch out business logic and basic tests

* Simplify rule scope building and action executions

* Get generator working again

* Basic implementation + tests

* Remove manual merchant management (rules will replace)

* Revert "Remove manual merchant management (rules will replace)"

This reverts commit 83dcbd9ff0.

* Family and Provider merchants model

* Fix brakeman warnings

* Fix notification loader

* Update notification position

* Add Rule action and condition registries

* Rule form with compound conditions and tests

* Split out notification types, add CTA type

* Rules form builder and Stimulus controller

* Clean up rule registry domain

* Clean up rules stimulus controller

* CTA message for rule when user changes transaction category

* Fix tests

* Lint updates

* Centralize notifications in Notifiable concern

* Implement category rule prompts with auto backoff and option to disable

* Fix layout bug caused by merge conflict

* Initialize rule with correct action for category CTA

* Add rule deletions, get rules working

* Complete dynamic rule form, split Stimulus controllers by resource

* Fix failing tests

* Change test password to avoid chromium conflicts

* Update integration tests

* Centralize all test password references

* Add re-apply rule action

* Rule confirm modal

* Run migrations

* Trigger rule notification after inline category updates

* Clean up rule styles

* Basic attribute locking for rules

* Apply attribute locks on user edits

* Log data enrichments, only apply rules to unlocked attributes

* Fix merge errors

* Additional merge conflict fixes

* Form UI improvements, ignore attribute locks on manual rule application

* Batch AI auto-categorization of transactions

* Auto merchant detection, ai enrichment in batches

* Fix Plaid merchant assignments

* Plaid category matching

* Cleanup 1

* Test cleanup

* Remove stale route

* Fix desktop chat UI issues

* Fix mobile nav styling issues

app/models/family.rb

@@ -22,12 +22,13 @@ class Family < ApplicationRecord
 
   has_many :entries, through: :accounts
   has_many :transactions, through: :accounts
+  has_many :rules, dependent: :destroy
   has_many :trades, through: :accounts
   has_many :holdings, through: :accounts
 
   has_many :tags, dependent: :destroy
   has_many :categories, dependent: :destroy
-  has_many :merchants, dependent: :destroy
+  has_many :merchants, dependent: :destroy, class_name: "FamilyMerchant"
 
   has_many :budgets, dependent: :destroy
   has_many :budget_categories, through: :budgets
@@ -35,6 +36,27 @@ class Family < ApplicationRecord
   validates :locale, inclusion: { in: I18n.available_locales.map(&:to_s) }
   validates :date_format, inclusion: { in: DATE_FORMATS.map(&:last) }
 
+  def assigned_merchants
+    merchant_ids = transactions.where.not(merchant_id: nil).pluck(:merchant_id).uniq
+    Merchant.where(id: merchant_ids)
+  end
+
+  def auto_categorize_transactions_later(transactions)
+    AutoCategorizeJob.perform_later(self, transaction_ids: transactions.pluck(:id))
+  end
+
+  def auto_categorize_transactions(transaction_ids)
+    AutoCategorizer.new(self, transaction_ids: transaction_ids).auto_categorize
+  end
+
+  def auto_detect_transaction_merchants_later(transactions)
+    AutoDetectMerchantsJob.perform_later(self, transaction_ids: transactions.pluck(:id))
+  end
+
+  def auto_detect_transaction_merchants(transaction_ids)
+    AutoMerchantDetector.new(self, transaction_ids: transaction_ids).auto_detect
+  end
+
   def balance_sheet
     @balance_sheet ||= BalanceSheet.new(self)
   end
@@ -46,13 +68,20 @@ class Family < ApplicationRecord
   def sync_data(sync, start_date: nil)
     update!(last_synced_at: Time.current)
 
+    Rails.logger.info("Syncing accounts for family #{id}")
     accounts.manual.each do |account|
       account.sync_later(start_date: start_date, parent_sync: sync)
     end
 
+    Rails.logger.info("Syncing plaid items for family #{id}")
     plaid_items.each do |plaid_item|
       plaid_item.sync_later(start_date: start_date, parent_sync: sync)
     end
+
+    Rails.logger.info("Applying rules for family #{id}")
+    rules.each do |rule|
+      rule.apply_later
+    end
   end
 
   def remove_syncing_notice!
@@ -138,4 +167,8 @@ class Family < ApplicationRecord
       entries.maximum(:updated_at)
     ].compact.join("_")
   end
+
+  def self_hoster?
+    Rails.application.config.app_mode.self_hosted?
+  end
 end