AI Exam Prep - 3E Metrics

 

AI Practitioner Exam Prep - Metrics

Text Metric Terms
BERT = Text. scores semantic similarity (using cosine) between two sentences. Good for text generation, summarization, translation, and filling in missing words. think brainy Bert. Counts: words that mean the same.
BLEU = Text. Scores exact word translation did against human translated sample(s). Counts: exact words only. think translation because it is foreign spelling of blue. 
METEOR = Text. evaluates by exact matches, stemmed matches, and synonyms. focus on both recall and precision. think poetry meter. Counts: synonyms and word order.
Perplexity = Text. calcs how well probability model predicts a sample token, not the text quality. Counts: Confusion level of model of its prediction.
ROUGE = Text. Uses F1, precision, and recall versus a reference text. Good for text summary. think rogue makeup is for highlights (summaries). Counts: summary points.

Other Metric Terms
Conversion rate = measures customers that do action
RWK = measures if output aligns with known, real-world facts and info. high is accurate to real world.

Comments

Post a Comment

Popular posts from this blog

GHL Email Campaigns

GHL Email Campaigns Options  Option 1)    Tag free - Contacts > Quick Search box > filter data clicking to select > "Add to Automation" button > pick automation.  Option 2)   Automations > Workflows tab > pick workflow > start workflow with trigger component > click on it > pick "Contact Tag" >  "Add Filters" button > on filter add one that is "Tag Added" > pick which  type of tag. What Are The Tags 1) Settings > Tags > list of tags How to Add Tags 1) Bulk - Contacts > Quick Search box > filter data clicking to select > "Add Tag" button > pick tag 2) Single - Add tag when add contact 3) Bulk - ( Only Admin ) - In file to import, put Tags in column - Contacts > Import Contacts button > Contacts > decide columns. Everyone seems to tag the import with date AND tag it cold or hot if they can. 4) 
Read more

Whitelabel Options

Whitelabel Options   Whitelabel is selling someone else's solution but with your own label.  So different from car dealer where the cars still are known by the original manufacturer, but more like a generic product with your brand like Walmart's "Great Value" that does not manufacture the item.  Basically you are rewrapping someone else's solution. You become a non-employee salesman, but with your own company. 1) AiFrontDesk https://www.myaifrontdesk.com/white-label Stripe Rebilling Feature Gating Website Embedding    iframe on website    route their domain to our backend GTM Advice 24/7 Technical Support Detailed Analytics They want $100/license for first 10, then $50/license for next 40 so not economically viable if only $100/mth since only $37k/year. Would have to do $200/mth or more.  Their basic is $65/mth and $50/mth if paid year up front.  So they must prefer competitors. Paige at    1 (201) 228-1089 A better deal would be "M...
Read more

Await

 https://www.reddit.com/r/csharp/comments/oxaoj4/c_why_use_async_if_i_must_await_for_the_response/ https://blog.ndepend.com/c-async-await-explained/
Read more