If I have a known camera pose(Rotation + Position), and Intrinsics(distortion coefficients and camera matrix), and 2 cameras pointing at the same scene from slightly different angles.
Is there a way to use bundle adjustment to refine the camera pose? Preferably in some already existing API or function that doesent require too much mathematical knowledge to use.
You should use PBA (Multicore Bundle Adjustment) from Changchang Wu. It is really a nice library and it is written in C++. Furthermore, it features multi core computations and even GPU computation with a speedup of about 20 times.
It is clearly structured and easy to use.
So, instead of using SBA from Lourakis or using SSBA from Christopher Zach you should use PBA.