Skip to content

Commit

Permalink
review comments
Browse files Browse the repository at this point in the history
Signed-off-by: Alexander Matveev <[email protected]>
  • Loading branch information
alexm-redhat committed Dec 10, 2024
1 parent c86e5b2 commit 0e26569
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions vllm/v1/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -71,9 +71,9 @@ def __init__(self, size: int):
self.cache = OrderedDict()
self.size = size

def get(self, key):
def get(self, key, default = None):
if key not in self.cache:
return None
return default

self.cache.move_to_end(key)
return self.cache[key]
Expand Down

0 comments on commit 0e26569

Please sign in to comment.