simplify

x^5-x^3+x^2-1-(x^3-1)(x+1)^2/(x^2-1)^2

Assuming that the whole left side is over the whole right side, we have

x^5-x^3+x^2-1-(x^3-1)(x+1)^2/(x^2-1)^2
= [x^3(x^2-1) + (x^2-1) - (x^3-1)(x+1)^2] / (x^2-1)^2

= [(x+1)^2(x-1)(x^2-x+1) - (x+1)^2(x-1)(x^2+x+1)]/(x+1)^2(x-1)^2

= -2x/(x-1)