task: Module cleanup

This patch also cleans up the task module implementation to reduce redundant
code and also to prepare for following patches

Signed-off-by: Yuji Mano <yuji.mano@am.sony.com>
Acked-by: Kazunori Asayama <asayama@sm.sony.co.jp>