AFAIK if an app was installed by dragging it to Applications, there’s no way it could still run after you delete it. The actual executable is contained within the .app file.

It is true that uninstalled apps can leave files behind in other places though. Which is a problem on all platforms.