---------------custom config-------------- run: mode: autoline save: en: True pub: prefix: SimpleSPI subdir: MyExperimentsSimple gpt: model: qwen-max rtlgen_model: qwen-max autoline: result_path: results/myproject_simple_spi cga: enabled: True max_iter: 15 target_coverage: 85.0 probset: path: data/myproject/spi_controller_simple.jsonl mutant_path: None more_info_paths: [] only: ['spi_controller_simple'] promptscript: pychecker timeout: 300 save_compile: False debug: max: 3 itermax: 10 update_desc: False TBcheck: discrim_mode: col_70_wrong_row_25_correct ------------------------------------------ ------config info (custom + default)------ run: version: 2.0 author: Ruidi Qiu - Technical University of Munich time: 20260406_205249 custom_path: config/myproject_simple_spi.yaml mode: autoline hostname: localhost pid: 67546 pyversion: 3.12.3 (main, Mar 3 2026, 12:15:18) [GCC 13.3.0] save: en: True root: saves/0406~0412/MyExperimentsSimple/SimpleSPI_20260406_205249/ pub: prefix: SimpleSPI dir: saves/0406~0412/ subdir: MyExperimentsSimple/ log: en: True dir: logs/ notes: None cfg_pmode: iwantall debug_en: False level: TRACE message: en: True dir: messages/ format: json iverilog: en: True subdir: ivcode_nodebug load: prompt: path: config/initial_prompts/prompt1.txt pick_idx: [] stage_template: path: config/templates/stage_template0301.txt gpt: model: qwen-max key_path: config/key_API.json temperature: None json_mode: False chatgpt: start_form: chat one_time_talk: False rtlgen_model: qwen-max iverilog: dir: task_id: autoline: result_path: results/myproject_simple_spi cga: enabled: True max_iter: 15 target_coverage: 85.0 probset: path: data/myproject/spi_controller_simple.jsonl mutant_path: None gptgenRTL_path: None more_info_paths: [] only: ['spi_controller_simple'] exclude: [] exclude_json: None filter: [{}] checklist: max: 3 debug: max: 3 reboot: 1 py_rollback: 2 onlyrun: None promptscript: pychecker timeout: 300 TBcheck: rtl_num: 20 correct_max: 3 discrim_mode: col_70_wrong_row_25_correct correct_mode: naive rtl_compens_en: True rtl_compens_max_iter: 3 itermax: 10 update_desc: False save_compile: False save_finalcodes: True error_interruption: False _initialized: True ------------------------------------------ --------------default config-------------- run: version: 2.0 author: Ruidi Qiu - Technical University of Munich time: None custom_path: None mode: qwen-max save: en: True root: None pub: prefix: None dir: saves/$weekrange$/ subdir: log: en: True dir: logs/ notes: None cfg_pmode: iwantall debug_en: False level: TRACE message: en: True dir: messages/ format: json iverilog: en: True subdir: ivcode_nodebug load: prompt: path: config/initial_prompts/prompt1.txt pick_idx: [] stage_template: path: config/templates/stage_template0301.txt gpt: model: 4o key_path: config/key_API.json temperature: None json_mode: False chatgpt: start_form: chat one_time_talk: False rtlgen_model: None iverilog: dir: task_id: autoline: result_path: results cga: enabled: True max_iter: 10 target_coverage: 100.0 probset: path: None mutant_path: None gptgenRTL_path: None more_info_paths: [] only: ['lemmings3', 'lemmings4', 'ece241_2013_q8', '2014_q3fsm', 'm2014_q6', 'review2015_fsm', 'rule110', 'fsm_ps2'] exclude: [] exclude_json: None filter: [{}] checklist: max: 3 debug: max: 5 reboot: 1 py_rollback: 2 onlyrun: None promptscript: None timeout: 300 TBcheck: rtl_num: 20 correct_max: 3 discrim_mode: col_full_wrong correct_mode: naive rtl_compens_en: True rtl_compens_max_iter: 3 itermax: 10 update_desc: False save_compile: True save_finalcodes: True error_interruption: False ------------------------------------------ 2026-04-06 20:52:49 | INFO | all configurations are loaded, starting the main process... 2026-04-06 20:52:49 | INFO | 2026-04-06 20:52:49 | INFO | ######################### task 1/1 [spi_controller_simple] ######################### 2026-04-06 20:53:18 | INFO | [spi_controller_simple] [TBgen] stage_0 ends (29.29s used) 2026-04-06 20:54:03 | INFO | [spi_controller_simple] [TBgen] stage_1 ends (44.59s used) 2026-04-06 20:54:49 | INFO | [spi_controller_simple] [TBgen] stage_2 ends (46.03s used) 2026-04-06 20:55:43 | INFO | [spi_controller_simple] [TBgen] stage_3 ends (54.57s used) 2026-04-06 21:22:11 | INFO | [spi_controller_simple] [TBgen] stage_4 ends (1587.91s used) 2026-04-06 21:22:11 | INFO | [spi_controller_simple] [TBgen] stage_checklist ends (0.00s used) 2026-04-06 21:26:43 | INFO | [spi_controller_simple] [TBgen] stage_4b ends (271.62s used) 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBgen] stage_5 ends (28.76s used) 2026-04-06 21:27:12 | INFO | [spi_controller_simple] 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBsim] iverilog compilation : passed! 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBsim] python simulation : passed! 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBsim] TBsim finished : True! 2026-04-06 21:27:12 | INFO | [spi_controller_simple] 2026-04-06 21:27:12 | INFO | [spi_controller_simple] rtl list not found, generating naive rtls for testbench checking 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: single_bit_flip | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: invert_single_signal | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: single_bit_flip | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: invert_single_signal | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: swap_shift | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: invert_single_signal | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: single_bit_flip | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: invert_single_signal | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: wrong_bit_index | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: invert_single_signal | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: invert_single_signal | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: width_mismatch | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | DEBUG | [spi_controller_simple] Applied mutation: tiny_offset | location: autoline/rtl_mutator.py, func: _safe_log, line: 33 2026-04-06 21:27:12 | INFO | [spi_controller_simple] 20 mutation-based RTLs generated (from reference RTL) 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBcheck] [discriminator] Plan 2: Capturing Reference RTL outputs as ground truth... 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBcheck] [discriminator] Capturing Reference RTL outputs as ground truth... 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBcheck] [discriminator] Reference RTL check results: failed scenarios = [1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 3, 3, 4, 4, 4, 4, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 5], passed scenarios = [] 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBcheck] [discriminator] Captured Reference RTL outputs for 5 scenarios 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBcheck] [discriminator] Plan 2: Captured outputs for 5 scenarios 2026-04-06 21:27:12 | INFO | [spi_controller_simple] [TBcheck] [discriminator] Discriminating the testbench, NO.0 discrimination 2026-04-06 21:27:15 | INFO | [spi_controller_simple] [TBcheck] [discriminator] RTL(s) [19] have syntax error during discrimination 2026-04-06 21:27:15 | POSITIVE | [spi_controller_simple] [TBcheck] [discriminator] TB_discriminating finished, TB passed, wrong scenarios: [], scenario pass ratio: 1/5 2026-04-06 21:27:15 | INFO | [spi_controller_simple] [TBcheck] Testbench passed the funccheck 2026-04-06 21:27:15 | INFO | [spi_controller_simple] [TBcheck] self funccheck finished. Next Action: [pass] 2026-04-06 21:27:15 | INFO | [spi_controller_simple] 2026-04-06 21:27:15 | INFO | [spi_controller_simple] [spi_controller_simple] Starting Coverage-Guided Agent (CGA)... 2026-04-06 21:27:15 | INFO | [spi_controller_simple] [spi_controller_simple] Running Semantic Analysis (Layer 0)... 2026-04-06 21:27:15 | INFO | [spi_controller_simple] FSM detected: state (4 states) 2026-04-06 21:27:15 | INFO | [spi_controller_simple] Total function points identified: 8 2026-04-06 21:27:15 | INFO | [spi_controller_simple] Energy allocator initialized: 8 targets 2026-04-06 21:27:15 | INFO | [spi_controller_simple] Diversity injector initialized with history file: saves/0406~0412/MyExperimentsSimple/SimpleSPI_20260406_205249/spi_controller_simple/CGA/test_history.json 2026-04-06 21:27:15 | INFO | [spi_controller_simple] Quality evaluator initialized 2026-04-06 21:27:15 | INFO | [spi_controller_simple] --- CGA Iter 0 (Baseline) --- 2026-04-06 21:27:17 | INFO | [spi_controller_simple] Baseline Coverage: 93.88% 2026-04-06 21:27:17 | SUCCESS | [spi_controller_simple] Target reached at baseline! 2026-04-06 21:27:17 | INFO | [spi_controller_simple] Saved optimized TB to: saves/0406~0412/MyExperimentsSimple/SimpleSPI_20260406_205249/spi_controller_simple/final_TB.v 2026-04-06 21:27:17 | INFO | [spi_controller_simple] [TBeval] Eval 1: Golden RTL checking begins 2026-04-06 21:27:17 | FAILED | [spi_controller_simple] [TBeval] Eval 1: Golden RTL checking failed! 2026-04-06 21:27:17 | INFO | [spi_controller_simple] [TBeval] [spi_controller_simple] Eval 2/2b is skipped because Eval 1 failed 2026-04-06 21:27:17 | INFO | [spi_controller_simple] 2026-04-06 21:27:17 | INFO | ########## Analyze of Chatbench_RunInfo ########## #### pass numbers: Eval2 : 0 Eval1 : 0 Eval0 : 1 total : 1 (Failed: 0) passed TB by autoline reboot action (from TB3_check): 0 passed TB by functional corrector: 0 #### CGA Coverage Info: Average Coverage : 93.88% Max Coverage : 93.88% Min Coverage : 93.88% #### tokens and cost: average prompt tokens: 11100 average completion tokens: 10023 total cost: 0.8234 average cost: 0.8234 #### time: average time: 2068.34s #### debug info table: FUNCTIONAL debug info table: (debugged here means functional debugging) | un-func-debugged | func-debugged | total | failed | 0 | 0 | 0 | Eval0 | 1 | 0 | 1 | Eval1 | 0 | 0 | 0 | Eval2 | 0 | 0 | 0 | #### Eval2 ratio: #### CGA Coverage Detail List: Task ID | Coverage ---------------------------------------- spi_controller_simple | 93.88% loose Eval2 pass metric applied: 0.8