How to open a link, fill data then click a button with no browser?












0















What I need is to open a web page with a link fill some textbox with my data, click in any button and then read the data of the page in C#.
For example :



Open (www.google.es) then fill the search box with "stackOverFlow", click on the search button and then read the results.



I've been looking and I think I can read the data with HttpClient but I have no clue about how to proceed with the other part.



Edit: Actually using a .net Framework console aplicattion but I can change this to an MVC app or a Winform app






c# .net web







share|improve this question




















  • 1





    Is your example remotly correct? If so, that isn't necessary - since you could just simply build the URL yourself with the search query. So, instead of going to "google.es" and enter stuff into TextBox just build the URL and navigate to the URL directly "google.es/search?q=stackOverFlow"

    – Rand Random
    Nov 14 '18 at 8:44








  • 1





    Unfortunately no, is just an example. I would like to do a generic methods.

    – Fran
    Nov 14 '18 at 8:53











  • Submitting a form executes a POST request. You don't need a browser to do that. You can use HttpClient.PostAsync to send the same request. You can use a debugging proxy like Fiddler to see what that form actually sends to the server and create an equivalent request

    – Panagiotis Kanavos
    Nov 14 '18 at 9:06











  • The response of PostAsync will contain the new page, which you can parse to extract the data you want. HTML parsing isn't trivial though. If you want to extract the contents of specified form fields or named elements you may be able to use regex. Otherwise you'll need a parser like HtmlAgility

    – Panagiotis Kanavos
    Nov 14 '18 at 9:09











  • Rand Random gave a good solution for Google. A generic solution (all pages) may be impossible. You can't always find the form to POST your search to, without executing the javascript ! Consider using CefSharp, which can provide a browser in a form.. then use Wolinski's answer below after the page is loaded. See: myget.org/feed/cefsharp/package/nuget/CefSharp.WinForms

    – Goodies
    Nov 14 '18 at 9:45


















0















What I need is to open a web page with a link fill some textbox with my data, click in any button and then read the data of the page in C#.
For example :



Open (www.google.es) then fill the search box with "stackOverFlow", click on the search button and then read the results.



I've been looking and I think I can read the data with HttpClient but I have no clue about how to proceed with the other part.



Edit: Actually using a .net Framework console aplicattion but I can change this to an MVC app or a Winform app






c# .net web







share|improve this question




















  • 1





    Is your example remotly correct? If so, that isn't necessary - since you could just simply build the URL yourself with the search query. So, instead of going to "google.es" and enter stuff into TextBox just build the URL and navigate to the URL directly "google.es/search?q=stackOverFlow"

    – Rand Random
    Nov 14 '18 at 8:44








  • 1





    Unfortunately no, is just an example. I would like to do a generic methods.

    – Fran
    Nov 14 '18 at 8:53











  • Submitting a form executes a POST request. You don't need a browser to do that. You can use HttpClient.PostAsync to send the same request. You can use a debugging proxy like Fiddler to see what that form actually sends to the server and create an equivalent request

    – Panagiotis Kanavos
    Nov 14 '18 at 9:06











  • The response of PostAsync will contain the new page, which you can parse to extract the data you want. HTML parsing isn't trivial though. If you want to extract the contents of specified form fields or named elements you may be able to use regex. Otherwise you'll need a parser like HtmlAgility

    – Panagiotis Kanavos
    Nov 14 '18 at 9:09











  • Rand Random gave a good solution for Google. A generic solution (all pages) may be impossible. You can't always find the form to POST your search to, without executing the javascript ! Consider using CefSharp, which can provide a browser in a form.. then use Wolinski's answer below after the page is loaded. See: myget.org/feed/cefsharp/package/nuget/CefSharp.WinForms

    – Goodies
    Nov 14 '18 at 9:45
















0












0








0








What I need is to open a web page with a link fill some textbox with my data, click in any button and then read the data of the page in C#.
For example :



Open (www.google.es) then fill the search box with "stackOverFlow", click on the search button and then read the results.



I've been looking and I think I can read the data with HttpClient but I have no clue about how to proceed with the other part.



Edit: Actually using a .net Framework console aplicattion but I can change this to an MVC app or a Winform app






c# .net web







share|improve this question
















What I need is to open a web page with a link fill some textbox with my data, click in any button and then read the data of the page in C#.
For example :



Open (www.google.es) then fill the search box with "stackOverFlow", click on the search button and then read the results.



I've been looking and I think I can read the data with HttpClient but I have no clue about how to proceed with the other part.



Edit: Actually using a .net Framework console aplicattion but I can change this to an MVC app or a Winform app






c# .net web




c# .net web






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 14 '18 at 8:26







Fran

















asked Nov 14 '18 at 8:19









Fran Fran

558




558








  • 1





    Is your example remotly correct? If so, that isn't necessary - since you could just simply build the URL yourself with the search query. So, instead of going to "google.es" and enter stuff into TextBox just build the URL and navigate to the URL directly "google.es/search?q=stackOverFlow"

    – Rand Random
    Nov 14 '18 at 8:44








  • 1





    Unfortunately no, is just an example. I would like to do a generic methods.

    – Fran
    Nov 14 '18 at 8:53











  • Submitting a form executes a POST request. You don't need a browser to do that. You can use HttpClient.PostAsync to send the same request. You can use a debugging proxy like Fiddler to see what that form actually sends to the server and create an equivalent request

    – Panagiotis Kanavos
    Nov 14 '18 at 9:06











  • The response of PostAsync will contain the new page, which you can parse to extract the data you want. HTML parsing isn't trivial though. If you want to extract the contents of specified form fields or named elements you may be able to use regex. Otherwise you'll need a parser like HtmlAgility

    – Panagiotis Kanavos
    Nov 14 '18 at 9:09











  • Rand Random gave a good solution for Google. A generic solution (all pages) may be impossible. You can't always find the form to POST your search to, without executing the javascript ! Consider using CefSharp, which can provide a browser in a form.. then use Wolinski's answer below after the page is loaded. See: myget.org/feed/cefsharp/package/nuget/CefSharp.WinForms

    – Goodies
    Nov 14 '18 at 9:45
















  • 1





    Is your example remotly correct? If so, that isn't necessary - since you could just simply build the URL yourself with the search query. So, instead of going to "google.es" and enter stuff into TextBox just build the URL and navigate to the URL directly "google.es/search?q=stackOverFlow"

    – Rand Random
    Nov 14 '18 at 8:44








  • 1





    Unfortunately no, is just an example. I would like to do a generic methods.

    – Fran
    Nov 14 '18 at 8:53











  • Submitting a form executes a POST request. You don't need a browser to do that. You can use HttpClient.PostAsync to send the same request. You can use a debugging proxy like Fiddler to see what that form actually sends to the server and create an equivalent request

    – Panagiotis Kanavos
    Nov 14 '18 at 9:06











  • The response of PostAsync will contain the new page, which you can parse to extract the data you want. HTML parsing isn't trivial though. If you want to extract the contents of specified form fields or named elements you may be able to use regex. Otherwise you'll need a parser like HtmlAgility

    – Panagiotis Kanavos
    Nov 14 '18 at 9:09











  • Rand Random gave a good solution for Google. A generic solution (all pages) may be impossible. You can't always find the form to POST your search to, without executing the javascript ! Consider using CefSharp, which can provide a browser in a form.. then use Wolinski's answer below after the page is loaded. See: myget.org/feed/cefsharp/package/nuget/CefSharp.WinForms

    – Goodies
    Nov 14 '18 at 9:45










1




1





Is your example remotly correct? If so, that isn't necessary - since you could just simply build the URL yourself with the search query. So, instead of going to "google.es" and enter stuff into TextBox just build the URL and navigate to the URL directly "google.es/search?q=stackOverFlow"

– Rand Random
Nov 14 '18 at 8:44







Is your example remotly correct? If so, that isn't necessary - since you could just simply build the URL yourself with the search query. So, instead of going to "google.es" and enter stuff into TextBox just build the URL and navigate to the URL directly "google.es/search?q=stackOverFlow"

– Rand Random
Nov 14 '18 at 8:44






1




1





Unfortunately no, is just an example. I would like to do a generic methods.

– Fran
Nov 14 '18 at 8:53





Unfortunately no, is just an example. I would like to do a generic methods.

– Fran
Nov 14 '18 at 8:53













Submitting a form executes a POST request. You don't need a browser to do that. You can use HttpClient.PostAsync to send the same request. You can use a debugging proxy like Fiddler to see what that form actually sends to the server and create an equivalent request

– Panagiotis Kanavos
Nov 14 '18 at 9:06





Submitting a form executes a POST request. You don't need a browser to do that. You can use HttpClient.PostAsync to send the same request. You can use a debugging proxy like Fiddler to see what that form actually sends to the server and create an equivalent request

– Panagiotis Kanavos
Nov 14 '18 at 9:06













The response of PostAsync will contain the new page, which you can parse to extract the data you want. HTML parsing isn't trivial though. If you want to extract the contents of specified form fields or named elements you may be able to use regex. Otherwise you'll need a parser like HtmlAgility

– Panagiotis Kanavos
Nov 14 '18 at 9:09





The response of PostAsync will contain the new page, which you can parse to extract the data you want. HTML parsing isn't trivial though. If you want to extract the contents of specified form fields or named elements you may be able to use regex. Otherwise you'll need a parser like HtmlAgility

– Panagiotis Kanavos
Nov 14 '18 at 9:09













Rand Random gave a good solution for Google. A generic solution (all pages) may be impossible. You can't always find the form to POST your search to, without executing the javascript ! Consider using CefSharp, which can provide a browser in a form.. then use Wolinski's answer below after the page is loaded. See: myget.org/feed/cefsharp/package/nuget/CefSharp.WinForms

– Goodies
Nov 14 '18 at 9:45







Rand Random gave a good solution for Google. A generic solution (all pages) may be impossible. You can't always find the form to POST your search to, without executing the javascript ! Consider using CefSharp, which can provide a browser in a form.. then use Wolinski's answer below after the page is loaded. See: myget.org/feed/cefsharp/package/nuget/CefSharp.WinForms

– Goodies
Nov 14 '18 at 9:45














2 Answers
2






active

oldest

votes


















0














You should be able to type input by calling script:



document.getElementById("Input").value = "My value";


and then post it by calling script from question below or simulate button clink (if you are not sure that button do post)



JavaScript post request like a form submit



Simulating Button click in javascript






share|improve this answer































    0














    If you are trying to create a custom search and show result in your own application, you will need to find the implementation of rest API of that search provider. To get started, luckily google provides that.



    follow the link to get started:
    https://developers.google.com/custom-search/v1/overview






    share|improve this answer























      Your Answer






      StackExchange.ifUsing("editor", function () {
      StackExchange.using("externalEditor", function () {
      StackExchange.using("snippets", function () {
      StackExchange.snippets.init();
      });
      });
      }, "code-snippets");

      StackExchange.ready(function() {
      var channelOptions = {
      tags: "".split(" "),
      id: "1"
      };
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function() {
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled) {
      StackExchange.using("snippets", function() {
      createEditor();
      });
      }
      else {
      createEditor();
      }
      });

      function createEditor() {
      StackExchange.prepareEditor({
      heartbeatType: 'answer',
      autoActivateHeartbeat: false,
      convertImagesToLinks: true,
      noModals: true,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: 10,
      bindNavPrevention: true,
      postfix: "",
      imageUploader: {
      brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
      contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
      allowUrls: true
      },
      onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      });


      }
      });














      draft saved

      draft discarded


















      StackExchange.ready(
      function () {
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53295705%2fhow-to-open-a-link-fill-data-then-click-a-button-with-no-browser%23new-answer', 'question_page');
      }
      );

      Post as a guest















      Required, but never shown

























      2 Answers
      2






      active

      oldest

      votes








      2 Answers
      2






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes









      0














      You should be able to type input by calling script:



      document.getElementById("Input").value = "My value";


      and then post it by calling script from question below or simulate button clink (if you are not sure that button do post)



      JavaScript post request like a form submit



      Simulating Button click in javascript






      share|improve this answer




























        0














        You should be able to type input by calling script:



        document.getElementById("Input").value = "My value";


        and then post it by calling script from question below or simulate button clink (if you are not sure that button do post)



        JavaScript post request like a form submit



        Simulating Button click in javascript






        share|improve this answer


























          0












          0








          0







          You should be able to type input by calling script:



          document.getElementById("Input").value = "My value";


          and then post it by calling script from question below or simulate button clink (if you are not sure that button do post)



          JavaScript post request like a form submit



          Simulating Button click in javascript






          share|improve this answer













          You should be able to type input by calling script:



          document.getElementById("Input").value = "My value";


          and then post it by calling script from question below or simulate button clink (if you are not sure that button do post)



          JavaScript post request like a form submit



          Simulating Button click in javascript







          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Nov 14 '18 at 8:59









          Michał WolińskiMichał Woliński

          15412




          15412

























              0














              If you are trying to create a custom search and show result in your own application, you will need to find the implementation of rest API of that search provider. To get started, luckily google provides that.



              follow the link to get started:
              https://developers.google.com/custom-search/v1/overview






              share|improve this answer




























                0














                If you are trying to create a custom search and show result in your own application, you will need to find the implementation of rest API of that search provider. To get started, luckily google provides that.



                follow the link to get started:
                https://developers.google.com/custom-search/v1/overview






                share|improve this answer


























                  0












                  0








                  0







                  If you are trying to create a custom search and show result in your own application, you will need to find the implementation of rest API of that search provider. To get started, luckily google provides that.



                  follow the link to get started:
                  https://developers.google.com/custom-search/v1/overview






                  share|improve this answer













                  If you are trying to create a custom search and show result in your own application, you will need to find the implementation of rest API of that search provider. To get started, luckily google provides that.



                  follow the link to get started:
                  https://developers.google.com/custom-search/v1/overview







                  share|improve this answer












                  share|improve this answer



                  share|improve this answer










                  answered Nov 14 '18 at 9:04









                  Tazbir BhuiyanTazbir Bhuiyan

                  1,3421424




                  1,3421424






























                      draft saved

                      draft discarded




















































                      Thanks for contributing an answer to Stack Overflow!


                      • Please be sure to answer the question. Provide details and share your research!

                      But avoid …



                      • Asking for help, clarification, or responding to other answers.

                      • Making statements based on opinion; back them up with references or personal experience.


                      To learn more, see our tips on writing great answers.




                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function () {
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53295705%2fhow-to-open-a-link-fill-data-then-click-a-button-with-no-browser%23new-answer', 'question_page');
                      }
                      );

                      Post as a guest















                      Required, but never shown





















































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown

































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown







                      -

                      Popular posts from this blog

                      List item for chat from Array inside array React Native

                      Image
                      0 This is my code for Chat Box, the window where I have "In" and "Out" messages are appearing. import React, { Component } from "react"; import { StyleSheet, Text, View, TouchableOpacity, TextInput, FlatList, Platform, AsyncStorage } from "react-native"; import Tutor from "../image/krutika.jpg"; import { Container, Header, Left, Input, Body, Right, Thumbnail, Button } from "native-base"; import FontAwesome from "react-native-vector-icons/FontAwesome"; import Ionicons from "react-native-vector-icons/Ionicons"; import Icon1 from "react-native-vector-icons/FontAwesome"; import axios from "axios"; export default class ChatBox extends Component { st...
                      Read more

                      Thiostrepton

                      Image
                      Thiostrepton [1] Names Other names Alaninamide, Bryamycin, Thiactin Identifiers CAS Number 1393-48-2   Y 3D model (JSmol) Interactive image ChEMBL ChEMBL468719   N ECHA InfoCard 100.014.304 PubChem CID 16130278 InChI InChI=1S/C72H85N19O18S5/c1-14-26(3)47-63(105)78-30(7)57(99)75-28(5)56(98)76-31(8)58(100)91-72-19-18-40(66-85-43(22-111-66)59(101)77-29(6)55(97)74-27(4)54(73)96)81-52(72)42-21-112-67(83-42)49(34(11)109-69(107)41-20-37(32(9)92)36-16-17-39(79-47)51(95)50(36)80-41)89-60(102)44-24-113-68(86-44)53(71(13,108)35(12)94)90-62(104)45-23-110-65(84-45)38(15-2)82-64(106)48(33(10)93)88-61(103)46-25-114-70(72)87-46/h15-17,20-22,24-26,30-35,39,45,47-49,51-53,79,92-95,108H,4-6,14,18-19,23H2,1-3,7-13H3,(H2,73,96)(H,74,97)(H,75,99)(H,76,98)(H,77,101)(H,78,105)(H,82,106)(H,88,103)(H,89,102)(H,90,104)(H,91,100)/b38-15-/t26-,30-,31-,32-,33+,34+,35+,39+,45+,47-,48-,49-,51-,52+,53+,71+,72+/m0/s1 Key: NSFFHOGKXHRQEW-AIHSUZKVSA-N ...
                      Read more

                      Caerphilly

                      Image
                      This article is about the town of Caerphilly. For the cheese of the same name, see Caerphilly cheese. For other uses, see Caerphilly (disambiguation). Caerphilly Welsh: Caerffili Caerphilly Castle Caerphilly Location within Caerphilly Population 30,388  OS grid reference ST1586 Principal area Caerphilly Ceremonial county Gwent Country Wales Sovereign state United Kingdom Post town CAERPHILLY Postcode district CF83 Dialling code 029 Police Gwent Fire South Wales Ambulance Welsh EU Parliament Wales UK Parliament Caerphilly Welsh Assembly Caerphilly List of places UK Wales Caerphilly 51°34′41″N 3°13′05″W  /  51.578°N 3.218°W  / 51.578; -3.218 Coordinates: 51°34′41″N 3°13′05″W  /  51.578°N 3.218°W  / 51.578; -3.218 Caerphilly ( / k aɪər ˈ f ɪ l i / ; Welsh: Caerffili , Welsh pronunciation:  [ˌkɑːɨrˈfɪlɪ] ) is a town and community in South Wales, at the southern end of the Rhymney Valley....
                      Read more