1-DAV-202 Data Management 2023/24
Previously 2-INF-185 Data Source Integration

Materials · Introduction · Rules · Contact
· Grades from marked homeworks are on the server in file /grades/userid.txt


HWcpp

From MAD
Revision as of 11:56, 12 April 2024 by Teacher (talk | contribs)
Jump to navigation Jump to search

See the lecture

You should implement all functionalities in two versions:

  • Pure Python
  • Python interface with C++ implementation

Task A

You are given a list of documents. Each document consists of multiple words separated by space. You should design and implement an indexing datastructure that allows the following two operations:

  • Add a document to the index (your index should assign it a unique ID)
  • Retrieve a document with the given ID
  • Find all documents that contain the given word

This is the recommended interface for your datastructure with its example usage:

from typing import List

class DocumentIndex:
  def __init__(self):
    """Initialize what you need here"""
  
  def add_document(self, document:str) -> int:
    """Adds document to index, generates unique id for it"""

  def get_document(self, document_id:int) -> str:
    """Returns document for given ID"""
   
  def search(self, word:str) -> List[int]:
    """Returns list of document IDs containing the given word"""

"""Example usage"""
index = DocumentIndex()

index.add_document("this is document one about frog") # Returns 47
index.add_document("this is document two about dog") # Returns 42
index.get_document(42) # Returns "this is document two about dog"
index.search("dog") # Returns [42]
index.search("cat") # Returns []
index.search("this") # Returns [47, 42] or [42, 47] order of documents is not relevant

Task B

Extend you index so that it support following query:

  • Given list of words (W1, W2, ...) find all documents, which contain all of the words (so each document has to contain all of the word from the query).

This is the recommended interface for your datastructure with its example usage:

from typing import List

class DocumentIndex:
  def __init__(self):
    """Initialize what you need here"""
  
  def add_document(self, document:str) -> int:
    """Adds document to index, generates unique id for it"""

  def get_document(self, document_id:int) -> str:
    """Returns document for given ID"""
   
  def search(self, word:str) -> List[int]:
    """Returns list of document IDs containing the given word"""

  def multi_search(self, words: List[str]) -> List[int]:
    """Returns list of document IDs that contains all of the words"""

"""Example usage"""
index = DocumentIndex()

index.add_document("this is document one about frog") # Returns 47
index.add_document("this is document two about dog") # Returns 42
index.get_document(42) # Returns "this is document two about dog"
index.search("dog") # Returns [42]
index.search("cat") # Returns []
index.search("this") # Returns [47, 42] or [42, 47] order of documents is not relevant
index.multi_search(["two", "frog"]) # Returns []
index.multi_search(["two", "dog"]) # Returns [42]