Skip to Main Content

Generative AI for Learning and Research

Acknowledge the limitation

GenAI tools, like other technology, have their strengths and limitations. It is important for all of us to acknowledge the limitations, try to minimize any potential risk, and use the tool in a way that upholds academic integrity. Below are aspects of limitations concerning the process of generation and the outputs:

  1. Accuracy and Credibility
    One of the greatest discussions about the limitations of GenAI, especially ChatGPT, is concerning AI hallucination. In general, this concerns the generation of false or fake information and having them presented as factual. The presence of this fabricated information is known to result from the large language model in which the training data and process are mostly based on statistical patterns, and the intelligent computer is incapable of understanding the reality or context behind the data. For instance, ChatGPT may sometimes provide inaccurate, incomplete, or misleading information since it lacks training from authoritative resources and the capability to verify information. This would hinder the quality of works by making them trustworthy and believable and endanger the accuracy and credibility of outputs.
     
  2. Reliability
    In relevance to accuracy and credibility, GenAI tool is often reported to have different outputs from time to time while identical prompt is inserted. Consistency and dependability of information over time may be another concern for GenAI tools that will eventually affect their reliability.
     
  3. Data security and privacy
    How inserted data is being handled, such as your conversation with the tool or registered personal information when using the tool, remains another great concern. Some may suspect the collected data would be used to train future models, which could result in data leakage, while others concern the regulation of data extraction and scrapping from third-party platforms.
     
  4. Copyright concerns 
    If a generated image, audio or video is used for exhibit, who shall be the copyright owner? Wide discussion is found in society, with arguments on the definition and discrepancy between copyright owner and content creator (i.e. debates on authorship). There has been a continuous occurrence of lawsuits regarding the ownership of copyright, originality, and intellectual property rights.
     
  5. Ethical use and academic integrity
    While we understand the application of GenAI tools in the academic field, there is indeed a fine line in determining the benefits and convenience that come along with academic misconduct. The tool itself may be neutral, but how you use it and under what context may bring different results.
     
  6. Bias
    The training data may contain biases in politics, cultures, ideologies, religions, etc. For instance, ChatGPT may directly offer unfair or discriminatory information since it lacks ethical judgement or moral reasoning.

Strategies when using GenAI tools

While we acknowledge the limitations of GenAI tools, there are some tips on how to use these tools in a smart way:

  • Be critical
    Always evaluate the information provided by GenAI tools critically, e.g., any error, discrimination / contradiction? too abnormal, novel / exaggerating? Avoid using unverified, questionable information if you have concerns.
    You are also encouraged to verify the responses with the original sources or authoritative platforms. For instance, make use of Library resources to find updated information for your topic, verify generated contents and make your paper more professional and academic.
     
  • Avoid excessive use of generated contents
    Do not rely solely on AI-generated contents for academic works. Only use a reasonable amount of content to avoid plagiarism, and revise the content to be more humanized and personalized by yourself or "humanize AI text tools". 
     
  • Create effective prompts
    Better prompts can return better responses and minimize the issue of bias and misinformation. Master the skills in crafting a prompt while using the prompt generator as an assistant only. Visit the Crafting a prompt tab for more detailed information.
     
  • Ask for advice
    Teachers may have different requirements and expectations regarding using GenAI tools, with ChatGPT in particular, and they are experts in the subject areas; please consult them if you are in doubt. Meanwhile, our Librarians are pleased to offer support you need.

Further readings

Read more to learn more!