Skip to content

add local backend support for executing task_impl locally#907

Closed
lambda7xx wants to merge 14 commits intoflexflow:repo-refactorfrom
lambda7xx:repo-refactor-taskspec
Closed

add local backend support for executing task_impl locally#907
lambda7xx wants to merge 14 commits intoflexflow:repo-refactorfrom
lambda7xx:repo-refactor-taskspec

Conversation

@lambda7xx
Copy link
Collaborator

@lambda7xx lambda7xx commented Aug 2, 2023

Description of changes:

  • key idea: use local cuda allocator to allocate memory for OP and then execute the OP locally.
  • Add local backend support for env.get_fwd_accessor to measure OP cost. Currently env.get_fwd_accessor only supports legion.
    • add ITaskArgumentAccessor, and LocalTaskArgumentAccessor and LegionTaskArgumentAccessor.
    • add cuda allocator
    • implement the LocalTaskArgumentAccessor

Related Issues:

Linked Issues:

  • Issue #

Issues closed by this PR:

  • Closes #

Before merging:

  • Did you update the flexflow-third-party repo, if modifying any of the Cmake files, the build configs, or the submodules?

This change is Reviewable

@lockshaw lockshaw changed the title add local backend support for task_spec to measure OP cost add local backend support for executing task_impl locally Aug 8, 2023
@lambda7xx lambda7xx requested a review from lockshaw August 9, 2023 02:11
@lambda7xx lambda7xx force-pushed the repo-refactor-taskspec branch from a446d21 to e8a80c6 Compare August 16, 2023 02:04
@lockshaw lockshaw changed the base branch from tmp/pr842 to repo-refactor September 7, 2023 00:30
@lockshaw lockshaw linked an issue Sep 7, 2023 that may be closed by this pull request
@reyna-abhyankar reyna-abhyankar removed the request for review from lockshaw September 11, 2023 22:12
@lockshaw
Copy link
Collaborator

Moved to #1097

@lockshaw lockshaw closed this Oct 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add performance metric tracking for Simulator in measure_operator_cost

3 participants