Russia has pulled its troops out from the Ukraine border in an attempt to stem the growing violence in the country, Russian President Vladimir Putin announced Wednesday.

Putin also implored Ukrainian separatists to call off the referendum vote for sovereignty that is supposed to be held Sunday, according to The New York Times.

Speaking at the Kremlin, Putin said Russia wants to try diplomacy instead.

"We were told constantly about concerns over our troops near the Ukrainian border," Putin said. "We have pulled them back. Today they are not at the Ukrainian border but in places of regular exercises, at training grounds."

However, NATO officials said they have not yet seen signs that Russian forces have pulled back.

Putin said that he is appealing "to representatives of southeast Ukraine and supporters of federalization to hold off the referendum scheduled for May 11, in order to give this dialogue the conditions it needs to have a chance."

The Ukraine government in Kiev, as well as the pro-Russian separatists in East Ukraine, felt a sense of mistrust after the announcement. Pro-Ukrainians believe that Putin is trying to manipulate the situation once again, and the separatists are uncertain about Putin's aim.

Putin said that he wanted the authorities in Kiev to stop military actions in east Ukraine, and welcomed the release of militants who are being held by Ukraine.

"We think the most important thing now is to launch direct dialogue, genuine, full-fledged dialogue between the Kiev authorities and representatives of southeast Ukraine," he said.

"This dialogue could give people from southeast Ukraine the chance to see that their lawful rights in Ukraine really will be guaranteed," he added.

Putin also mentioned possible presidential elections occurring on May 25, which Moscow previously cancelled.

"Let me stress that the presidential election the Kiev authorities plan to hold is a step in the right direction, but it will not solve anything unless all of Ukraine's people first understand how their rights will be guaranteed once the election has taken place," Putin said.

Putin is demanding that Kiev grant some autonomy to the regions, including the ability to elect their own governors. That would allow Russia to have some control over the future of Ukraine, and put a possible veto on Ukraine's attempts to join the European Union.

"We all want the crisis to end as soon as possible, and in such a way that takes into account the interests of all people in Ukraine no matter where they live," Putin continued.

However, considering Putin's past actions, in which he said Russia's soldiers were not in Crimea when they actually were, this strategy could be a ruse as well.

Crimea and southeastern Ukraine have large populations of ethnic Russians, and Putin said that it was Moscow's right to intervene to protect them if they were in danger. However, Western governments have accused Russia of inciting the violence that it vowed to prevent.

Pro-Russian militants who seized buildings in a dozen cities in the East said they will still hold a referendum vote Sunday, and they will vote to join Russia or demand Russian protection. Either way, analysts say Putin will be forced to react.

"The decision was taken not to increase Russian involvement in Ukraine, and not to increase the chances of major violence there," said Konstantin von Eggert, a political analyst and a commentator for Kommersant FM radio.

While analysts believe Putin wants to avoid starting a war, sending troops into Ukraine would have been the beginning of a long, bloody conflict.

"This one would not have been bloodless," von Eggert said. "This would have been a real war, not by stealth, not by new methods, but a real old-fashioned war and this is something that Mr. Putin does not want."

Currently, the militants in Slovyansk in east Ukraine are still planning to hold the referendum vote Sunday.