Commit Graph

13 Commits

Author SHA1 Message Date
9ccc6b56ec Revert "Add switchable DIFF V1 attention"
This reverts commit bf5cae8758.
2026-08-21 13:16:39 +08:00
bf5cae8758 Add switchable DIFF V1 attention 2026-08-21 11:48:16 +08:00
de6f9b75b9 Remove legacy event and mixed distribution paths 2026-08-01 14:23:18 +08:00
dfb22adf2d Add train-split robust scaling for continuous values 2026-08-01 11:37:21 +08:00
c622ec50f7 Add disease history ablation modes 2026-07-29 13:53:15 +08:00
315f552301 refactor: isolate Delphi2M next-token pipeline 2026-07-25 14:22:36 +08:00
b13db5e407 Unify FFN and TrajMixer model architectures 2026-07-25 12:59:09 +08:00
ca294193f4 Clarify empty extra-info logging 2026-06-29 11:26:48 +08:00
e5ecb714ba Refactor loss computation and model input handling for improved clarity and efficiency 2026-06-20 11:26:03 +08:00
aa8ec5c3ac Refactor code structure for improved readability and maintainability 2026-06-18 13:07:35 +08:00
1757bcd25b Refactor DeepHealth model and related components
- Removed BaselineEncoder and CrossAttention classes from models.py.
- Introduced OtherInfoTokenizer for handling additional token types.
- Updated DeepHealth class to integrate OtherInfoTokenizer and manage extra pooling logic.
- Added support for extra_pool_reduce parameter to control pooling behavior.
- Modified forward methods to return structured output using DeepHealthOutput dataclass.
- Updated training scripts to accommodate changes in model architecture and output handling.
- Enhanced error handling and validation for input shapes and types.
2026-06-17 11:05:10 +08:00
27aefb2f90 Refactor run directory creation to use a unique naming function in training scripts 2026-06-15 14:54:06 +08:00
46a3dfe628 Add training scripts for all-future and next-step supervision with DeepHealth
- Implement `train_all_future.py` for training with query-conditioned all-future supervision.
- Implement `train_next_step.py` for training with next-token/next-time-point supervision.
- Introduce `train_util.py` for shared utility functions including logging, dataset splitting, and model checkpointing.
- Enhance argument parsing for both training scripts to accommodate new parameters.
- Update loss functions and model configurations to support the new training paradigms.
2026-06-13 11:42:04 +08:00