o^2-9/8o+81/256=0

Is the answer o=9/16, -9/8?

How did you get that second answer ?

you have a perfect square ....
(I am going to use the more traditional x)

x^2-9/8x+81/256=0
multiply each term by 256 , the LCM
256x^2 - 288x + 81=0
(16x - 9)^2 = 0
16x - 9 = 0
x = 9/16