If the line is ordered but not yet received, you can follow the steps below. If the line is already received, you need to un-receive it first.
In Amend Mode, right-click on the line and go to P/O details
Click Delete
PO line is deleted successfully.
You can then delete the line from the Cost Details tab.