In the Folders section of the Project Manager, when a .sql file is clicked it opens in a new window.
Is it possible for it to open in a new tab of the existing Editor window?
Yes, the desired outcome is achievable by dragging .sql files into the Editor - which will then open it in its own tab placed on selected Editor's toolbar.
