Comparing data sets with different measurements












0












$begingroup$


I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.



One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.



Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%



Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)



I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.



My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.



So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?



Thanks for any advice.










share|improve this question











$endgroup$




bumped to the homepage by Community 4 mins ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.















  • $begingroup$
    Scaling might help otherwise you can't compare
    $endgroup$
    – Aditya
    Mar 14 '18 at 0:38










  • $begingroup$
    Look into (ordinal) rank aggregation. Welcome to the site!
    $endgroup$
    – Emre
    Jun 12 '18 at 17:05


















0












$begingroup$


I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.



One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.



Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%



Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)



I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.



My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.



So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?



Thanks for any advice.










share|improve this question











$endgroup$




bumped to the homepage by Community 4 mins ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.















  • $begingroup$
    Scaling might help otherwise you can't compare
    $endgroup$
    – Aditya
    Mar 14 '18 at 0:38










  • $begingroup$
    Look into (ordinal) rank aggregation. Welcome to the site!
    $endgroup$
    – Emre
    Jun 12 '18 at 17:05
















0












0








0





$begingroup$


I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.



One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.



Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%



Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)



I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.



My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.



So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?



Thanks for any advice.










share|improve this question











$endgroup$




I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.



One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.



Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%



Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)



I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.



My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.



So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?



Thanks for any advice.







dataset statistics visualization data-cleaning descriptive-statistics






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Mar 13 '18 at 23:03







O B

















asked Mar 13 '18 at 22:48









O BO B

11




11





bumped to the homepage by Community 4 mins ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.







bumped to the homepage by Community 4 mins ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.














  • $begingroup$
    Scaling might help otherwise you can't compare
    $endgroup$
    – Aditya
    Mar 14 '18 at 0:38










  • $begingroup$
    Look into (ordinal) rank aggregation. Welcome to the site!
    $endgroup$
    – Emre
    Jun 12 '18 at 17:05




















  • $begingroup$
    Scaling might help otherwise you can't compare
    $endgroup$
    – Aditya
    Mar 14 '18 at 0:38










  • $begingroup$
    Look into (ordinal) rank aggregation. Welcome to the site!
    $endgroup$
    – Emre
    Jun 12 '18 at 17:05


















$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38




$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38












$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05






$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05












1 Answer
1






active

oldest

votes


















0












$begingroup$

You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.



But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.



Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.



You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.



Cheers






share|improve this answer









$endgroup$














    Your Answer





    StackExchange.ifUsing("editor", function () {
    return StackExchange.using("mathjaxEditing", function () {
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    });
    });
    }, "mathjax-editing");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "557"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f29049%2fcomparing-data-sets-with-different-measurements%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0












    $begingroup$

    You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.



    But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.



    Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
    As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.



    You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.



    Cheers






    share|improve this answer









    $endgroup$


















      0












      $begingroup$

      You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.



      But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.



      Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
      As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.



      You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.



      Cheers






      share|improve this answer









      $endgroup$
















        0












        0








        0





        $begingroup$

        You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.



        But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.



        Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
        As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.



        You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.



        Cheers






        share|improve this answer









        $endgroup$



        You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.



        But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.



        Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
        As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.



        You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.



        Cheers







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Mar 14 '18 at 14:56









        Vincenzo LavoriniVincenzo Lavorini

        1,314417




        1,314417






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Data Science Stack Exchange!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f29049%2fcomparing-data-sets-with-different-measurements%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Aikido

            Tivadar Csontváry Kosztka

            Metroo de Marsejlo