Love them or hate them, Story points aren’t going anywhere.
You can keep the debate rolling, you can keep arguing for points over hours or vice versa (I like vice versa myself).
But remember, they aren’t called “Task Points”, there is, and always will be a duration to finishing a task – start, middle, end.
Story points are an estimate, task work is the execution of the estimation, and you adjust your estimates (points) based on the execution of your tasks (the work).