Neural Magic develops an inference engine that data scientists can run on computers running CPUs, rather than specialized chips like GPUs or TPUs.