Because it isn't true that they are "financially responsible".
What happened to the Jews in Antiquity before capitalism in Europe and the Middle East was Christians and Muslims viewed banks, debt collectors, tax collectors and accountants, basically all financial services as scummy ass jobs.
Even in the New Testament tax collectors and money exchangers are hated.
Since under Christian and Muslim faith, loaning money and shit and charging an interest is sinful. So anything to do with handling money was frowned upon. It was respectable to earn a living using your hands and skills, not using other people's money. And using other people's money didn't make you rich as fuck back then.
But at the same time, respectable and upstanding jobs weren't accessible to the Jews. They were discriminated against.
So they were forced into getting the jobs that caused public scorn. Then those jobs slowly became respectable and now glamorized under capitalism.
Now you have this professional class of Jews in Europe that were in the family business of being a banker, debt collector, accountant, loaner of money, during the early days of capitalism becoming rich in Europe.
Everyone now really fucking hate them because early capitalism completely destroyed and rebuilt society in Europe and the Jews are the financial drivers of that process. Your father was a respectable shoemaker but now he gotta work in a factory, getting a nickle a day.
Then WW1 happens. Germany loses and blames their depression on greedy Jews. Then the Holocaust happens.
Black people don't understand this because it's stupid White people shit and we would love to be known as bankers, lawyers and shit. But Jews were in the West was pretty much banished to the scummy financial services industry or forced to starve until capitalism came.