Commit Graph

13 Commits

Author SHA1 Message Date
8d0d71292e Refactor TrajMixer to single residual 2026-07-24 15:25:02 +08:00
7b48cb8425 Fix RBF time-bias initialization 2026-07-24 14:39:15 +08:00
20c99484f3 Add two-stage TrajMixer mixing 2026-07-24 10:51:41 +08:00
85352dae0f Revert "Implement shared event-trajectory reasoning backbone"
This reverts commit 06f29c0f0a.
2026-07-23 16:05:00 +08:00
06f29c0f0a Implement shared event-trajectory reasoning backbone 2026-07-23 14:23:34 +08:00
68a6a3df88 Scale TrajMixer hidden width with head count 2026-07-22 16:14:52 +08:00
db0947ce9d Implement TrajMixer block 2026-07-22 11:52:44 +08:00
1757bcd25b Refactor DeepHealth model and related components
- Removed BaselineEncoder and CrossAttention classes from models.py.
- Introduced OtherInfoTokenizer for handling additional token types.
- Updated DeepHealth class to integrate OtherInfoTokenizer and manage extra pooling logic.
- Added support for extra_pool_reduce parameter to control pooling behavior.
- Modified forward methods to return structured output using DeepHealthOutput dataclass.
- Updated training scripts to accommodate changes in model architecture and output handling.
- Enhanced error handling and validation for input shapes and types.
2026-06-17 11:05:10 +08:00
36ec36c8a8 Add time attention mask handling and baseline class time computation to DeepHealth model 2026-06-15 14:35:10 +08:00
c3e49db859 Enhance DeepHealth model to incorporate CHECKUP state tokens in next-step training and evaluation, update dataset cache versioning, and improve handling of observed event histories. 2026-06-15 14:10:09 +08:00
593ecd2e71 Revert cross-attention integration into GPTBlock 2026-06-15 10:05:13 +08:00
c87c3b9f7c Add cross-attention support to GPTBlock and update DeepHealth model integration 2026-06-13 17:02:04 +08:00
5e979e061b Add target construction and training script for DeepHealth model
- Implemented target construction in `targets.py` for next-token and unique-time set supervision.
- Added validation functions and utility methods for target building.
- Created a comprehensive training script in `train.py` that includes data loading, model building, optimizer setup, and training loop with early stopping and logging.
- Integrated loss functions and readout mechanisms based on target modes.
- Established dataset splitting and DataLoader configurations for training, validation, and testing.
2026-06-12 10:28:16 +08:00