Crash while evaluating product of AutoDiffScalar matrices
Submitted by twa..@..il.com
Assigned to Nobody
Link to original bugzilla bug (#1161)
Version: 3.3 (current stable)
Platform: x86 - 64-bit
Description
Created attachment 649
Example demonstrating crash
See attached example. Seems pretty low level and not specific to AutoDiffScalar matrices.
Looks like in evaluateProductBlockingSizesHeuristic, evaluating
k = (k%max_kc)==0 ? max_kc
: max_kc - k_peeling * ((max_kc-1-(k%max_kc))/(k_peeling*(k/max_kc+1)));
results in taking an undefined remainder by zero (max_kc happens to evaluate to 0), triggering
Exception: EXC_ARITHMETIC (code=EXC_I386_DIV, subcode=0x0))
This is on OSX, but we get a crash on Linux too, so I filled in All. This used to work fine with Eigen 3.2.7, but causes a crash with 3.3 beta 1 and with the default branch. I will attach a stack trace to a follow up comment.
Attachment 649, "Example demonstrating crash":
file_1161.txt