Model Difference Analysis Report

Generated on: 2025-04-23 10:53:23

Models compared: claude3.7-sonnet-20250219, gpt-4o-2024-11-20

Percentile threshold: 20%

Model Root Rankings

ModelRoot Ranking
claude3.7-sonnet-202502195
gpt-4o-2024-11-206

Nodes with Significant Differences (Top 20%)

The following nodes show significant variation in ranking across models:

Node PathStd Devclaude3.7-sonnet-20250219gpt-4o-2024-11-20
root.roleplay.Style Types.Experimental Style.Glitch Art10.61172
root.roleplay.Theme Types.Emotional.Erotic7.78165
root.reasoning.Application Domains.Personal Development Guidance5.6691
root.roleplay.Theme Types.Sensory Simulation5.66113
root.coding.Programming Languages.Markup Languages.SVG5.6619
root.writing.Writing Domains.Literary Writing.Fiction.Erotic Fiction4.95815
root.mathematics.Mathematical Subfields.Algebra.Abstract Algebra4.9529
root.knowledge.Disciplinary Fields.Humanities and Social Sciences.Religious Studies4.9529
root.roleplay.Task Types.Educational.Trivia4.9581
root.coding.Technical Domains.Front-end Development.UI/UX Design4.9518
root.coding.Technical Domains.Front-end Development.Animation4.9518
root.coding.Technical Domains.Data Science.Model Creation4.9518
root.coding.Programming Languages.Scripting Languages.Script4.9529
root.coding.Programming Languages.Markup Languages.HTML4.9518
root.coding.Programming Languages.Markup Languages.CSS4.9518
root.mathematics.Task Types.Problem Solving.Word Problems4.24410
root.mathematics.Mathematical Subfields.Analysis.Real Analysis4.2439
root.reasoning.Reasoning Methods.Emotional Reasoning4.24126
root.roleplay.Task Types.Simulation.Life Scenario4.2471
root.roleplay.Task Types.Analytical.Character Analysis4.2471
root.roleplay.Theme Types.Horror.Psychological Thriller4.2493
root.roleplay.Theme Types.Comedy.Light Comedy4.2471
root.roleplay.Theme Types.Realistic.Maritime4.2471
root.roleplay.Style Types.Healing Style4.2493
root.roleplay.Style Types.Experimental Style.Abstract Concepts4.2471
root.coding.Task Types.Tool Usage.Terminal Interaction4.2417
root.coding.Technical Domains.Game Development.Player Mechanics4.2417
root.coding.Technical Domains.Front-end Development.Responsive Design4.2417
root.writing.Writing Domains.Professional Writing.Music.Songwriting3.5472
root.writing.Writing Domains.Professional Writing.Psychology3.5483
root.writing.Writing Domains.Literary Writing.Fiction.Adventure Writing3.5472
root.writing.Writing Domains.Literary Writing.Fiction.Mystery3.5427
root.mathematics.Task Types.Problem Solving.Practical Application3.5427
root.mathematics.Task Types.Logical Reasoning.Puzzle Solving3.5449
root.mathematics.Mathematical Subfields.Applied Mathematics.Economics3.54105
root.mathematics.Mathematical Subfields.Geometry.Differential Geometry3.5438
root.mathematics.Mathematical Subfields.Mathematical Foundations.Set Theory3.5427
root.mathematics.Mathematical Subfields.Analysis.Complex Analysis3.5427
root.mathematics.Mathematical Subfields.Analysis.Limits3.5449
root.mathematics.Mathematical Subfields.Analysis.Fourier Analysis3.5427
root.reasoning.Reasoning Methods.Analogical Reasoning3.5461
root.reasoning.Reasoning Methods.Logical Reasoning.Basic Counting Reasoning3.5483
root.knowledge.Disciplinary Fields.Natural Sciences.Chemistry3.5449
root.knowledge.Task Types.Information Processing.Chart Interpretation3.54105
root.roleplay.Task Types.Simulation.Social Simulation3.5472
root.roleplay.Task Types.Educational.Language Learning3.5472
root.roleplay.Task Types.Educational.General Advice3.5494
root.roleplay.Task Types.Educational.Skill Training3.5472
root.roleplay.Task Types.Creative.Scriptwriting3.5472
root.roleplay.Task Types.Interactive.Interactive Text Game3.5494
root.roleplay.Task Types.Analytical.Cross-Analysis3.5472
root.roleplay.Theme Types.Comedy.Absurd Comedy3.5461
root.roleplay.Theme Types.Realistic.Life3.5472
root.roleplay.Theme Types.Realistic.Real World3.5472
root.roleplay.Theme Types.Emotional3.5472
root.roleplay.Theme Types.Emotional.Sensitive3.5461
root.roleplay.Theme Types.Emotional.Emotional Support3.5494
root.roleplay.Theme Types.Fantasy.Supernatural3.5472
root.roleplay.Theme Types.Fantasy.Cosmic3.5483
root.roleplay.Theme Types.Thought.Philosophy3.5472
root.roleplay.Style Types.Humorous Style3.5472
root.roleplay.Style Types.Humorous Style.Light Humor3.5472
root.roleplay.Style Types.Experimental Style3.5472
root.roleplay.Style Types.Experimental Style.Eccentric3.5483
root.coding.Task Types.Development and Maintenance.Comment Generation3.5427
root.coding.Task Types.Development and Maintenance.Code Execution3.5416
root.coding.Task Types.Data Processing.Data Visualization3.5416
root.coding.Task Types.Data Processing.Database3.5416
root.coding.Technical Domains.Artificial Intelligence.Reinforcement Learning3.5427
root.coding.Technical Domains.Front-end Development3.5416
root.coding.Technical Domains.Front-end Development.DOM Manipulation3.5416
root.coding.Technical Domains.Front-end Development.Webpage Development3.5416
root.coding.Technical Domains.Back-end Development.Microservices3.5416
root.coding.Programming Languages.Data Languages.SQL3.5416
root.writing.Styles.Reddit Style2.8373
root.writing.Writing Domains.Functional Writing.Teaching.Language Learning2.8395
root.writing.Writing Domains.Functional Writing.Instructional Descriptive Writing2.8315
root.writing.Writing Domains.Functional Writing.Official Document Writing.Professional Application Writing.Proposal Writing2.8326
root.writing.Writing Domains.Media Writing.Blog Posts2.8326
root.writing.Writing Domains.Media Writing.Social Media2.8373
root.writing.Writing Domains.Media Writing.Web Content2.8326
root.writing.Writing Domains.Everyday Writing.Personal Leisure Writing2.8362
root.writing.Writing Domains.Everyday Writing.Interpersonal Communication2.8373
root.writing.Writing Domains.Literary Writing.Inspirational2.8337
root.writing.Writing Domains.Literary Writing.Parody Creation2.8362
root.writing.Writing Domains.Literary Writing.Scriptwriting2.8326
root.mathematics.Task Types.Visualization.Geometric Drawing2.8337
root.mathematics.Task Types.Logical Reasoning.Theoretical Derivation2.8337
root.mathematics.Mathematical Subfields.Analysis2.8337
root.mathematics.Mathematical Subfields.Analysis.Mathematical Analysis2.8337
root.mathematics.Mathematical Subfields.Probability and Statistics2.8348
root.mathematics.Mathematical Subfields.Algebra.Algebraic Geometry2.8359
root.mathematics.Mathematical Subfields.Discrete Mathematics.Combinatorics2.8348
root.mathematics.Mathematical Subfields.Discrete Mathematics.Automata Theory2.8362
root.mathematics.Mathematical Subfields.Discrete Mathematics.Graph Theory2.8315
root.mathematics.Mathematical Subfields.Computational Mathematics2.8326
root.reasoning.Task Types.Decision Making2.8373
root.reasoning.Reasoning Methods.Classification Reasoning2.8384
root.reasoning.Thinking Modes.Creative.Conceptual Thinking2.8373
root.reasoning.Application Domains.Negotiation2.8362
root.knowledge.Disciplinary Fields.Natural Sciences.Biology.Botany2.8315
root.knowledge.Disciplinary Fields.Natural Sciences.Physics.Nuclear Physics2.8351
root.knowledge.Disciplinary Fields.Arts and Culture.Performing Arts2.8395
root.roleplay.Task Types.Simulation.Task Simulation2.8373
root.roleplay.Task Types.Simulation.Creative Simulation2.8373
root.roleplay.Task Types.Educational2.8373
root.roleplay.Task Types.Educational.Academic Guidance2.8362
root.roleplay.Task Types.Creative2.8373
root.roleplay.Task Types.Interactive.Q&A2.83106
root.roleplay.Task Types.Interactive.Dialogue Type2.8373
root.roleplay.Task Types.Interactive.Realistic Interaction2.8373
root.roleplay.Task Types.Analytical2.8373
root.roleplay.Task Types.Analytical.Social and Political Issues2.8373
root.roleplay.Task Types.Analytical.Interpretation and Symbolic Analysis2.8373
root.roleplay.Task Types.Analytical.Social Issues2.8395
root.roleplay.Theme Types.Emotional.Romantic2.8373
root.roleplay.Theme Types.Fantasy.Magic2.8373
root.roleplay.Theme Types.Thought2.8373
root.roleplay.Theme Types.Thought.Politics2.8373
root.roleplay.Style Types.Experimental Style.Formal2.8373
root.coding.Task Types.Development and Maintenance.Code Conversion2.8326
root.coding.Task Types.Tool Usage.Automation2.8315
root.coding.Task Types.Tool Usage.Environment Configuration2.8315
root.coding.Task Types.Tool Usage.Automated Workflow2.8315
root.coding.Task Types.Tool Usage.Test Development2.8315
root.coding.Task Types.Auxiliary Functions.Self-Assessment2.8326
root.coding.Task Types.Auxiliary Functions.Fact Recall2.8362
root.coding.Task Types.Debugging and Optimization.Testing2.8315
root.coding.Technical Domains.Embedded Development.Sensors2.8326
root.coding.Technical Domains.Web Development2.8315
root.coding.Technical Domains.Game Development.Graphics Rendering2.8315
root.coding.Technical Domains.Game Development.Game Logic2.8326
root.coding.Technical Domains.Artificial Intelligence2.8326
root.coding.Technical Domains.Artificial Intelligence.Computer Vision2.8326
root.coding.Technical Domains.Back-end Development2.8315
root.coding.Technical Domains.Back-end Development.API Development2.8315
root.coding.Technical Domains.Back-end Development.Concurrent Programming2.8326
root.coding.Technical Domains.Back-end Development.Database Integration2.8315
root.coding.Technical Domains.Data Science.Data Visualization Tools2.8315
root.coding.Technical Domains.Data Structures and Algorithms2.8326
root.coding.Programming Languages.Scripting Languages.Shell2.8315
root.coding.Programming Languages.Domain-specific Languages.MQL (Finance)2.8315
root.coding.Programming Languages.Markup Languages2.8315
root.coding.Programming Languages.Markup Languages.YAML2.8315
root.coding.Programming Languages.Markup Languages.JSON2.8315
root.coding.Programming Languages.General-purpose Languages.TypeScript2.8315